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St. John Title VII Bilingual Program 

ABSTRACT 

The St. John Valley Bilingual Program for 1970-71 was 
instituted to help overcome the educational problems of 
French- speaking children in schools where lessons are conducted in 
English. Basically the program conducts instruction in the student's 
first language with an increasing use of the second language. This 
report focuses on the assessment of each objective within each 
project component: instruction, staff development, community 
involvement^ materials development, and program management. .The first 
part of the report summarizes the status of accomplishment of the 
first-year program goals for each component. Part 2 discusses the 
evaluation of each specific program objective and its status at the 
end of the program. Part 2 also presents the results of additional 
data gathered on the particular project components and commendations 
and recommendations for each component. Details on evaluation 
procedures are included. (Author/VM) 
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INTRODUCTION 

This report presents the evaluation of the St. John 
Valley Title VII Bilingual Program for the 1970-71 program 
year. The program served three school districts: SAD #33 - 

St. Agatha and Frenchville , Madawaska , and SAD # 24 - Van 
Buren . The program operated in kindergarten and grade one 
only, serving 122 kindergarten students and 145 grade one 
students in the three districts. 

The services of the evaluators, Mr. Gilman Hebert and 
Heuristics, Inc., were engaged before the start of classroom 
instruction; therefore, evaluation of the project was both 
formative and summative in nature. The evaluation focuses 
on the assessment of the particular objectives for the 
program components and on additional data gathered during 
the course of the program. 



DESCRIPTION OF THE PROGRAM 

The St. John Valley Bilingual Program for 1970-71 was 
the first year of operation of a Title VII bilingual grant 
in the St. John Valley. In the Valley where a large majority 
of students speak French as a first language and are, there- 
fore, handicapped in school where lessons are conducted in 
■ . n • 

English, the bilingual program conducts instruction in the 

student's first language with an increasing introduction and 
use of the second language in instruction. The first year of 
the program emphasized the development of readiness skills 
for the kindergarten children and basic language art skills 
for all program participants in both their first and second 
languages. In addition, the program focused on staff develop- 
ment, acquisition and development of materials for use in 
all phases of instruction, such as ESL and FSL, and infor- 
mation dissemination and community involvement. 

The program was held in six public schools in the three 
school districts, SAD #24, SAD #33, and Madawaska; each 
district had both kindergarten and first grade classes. The 
program was held during regular school hours, with the excep- 
tion of in-service training for the professional staff. 
Program activities required a refocusing and reorganization 
of the traditional curriculum in order to fodus on specific 
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behavioral objectives for the students and to include French 
instruction for both English-dominant and French-dominant 
students. 



Project personnel included a project director, 
curriculum coordinator , evaluator , eleven teachers, and 
eleven aides. Not all project personnel were paid with 
project funds. Many of the salaries were paid by the local 
educational agencies. All members of the project staff were 
bilingual, and the majority had experience in working in 
kindergarten and/or first grade classrooms. Each class had 
between 17 and 29 pupils. Additional documentation of 
program activities can be obtained from the project files 
and from information presented in this evaluation report. 
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EVALUATION PROCEDURES 

The evaluation of the St. John Valley Bilingual Program 
was conducted by Mr. Gilman Hebert and Heuristics, Inc. 

Mr. Hebert was responsible for on-site evaluation; this in- 
volved construction of instruments to measure the program 
objectives in cooperation with the project teachers , organ- 
ization of test administration , distribution of evaluation i 
materials to the teachers , organization of data into an appro-; 
priate form for analysis , and dissemination of information 
to project administrators and professional staff about the 
current status of the project and accomplishment of its 
objectives. Heuristics, Inc. was responsible for the refin- 
ing of the evaluation design, training the local evaluator, 
providing technical assistance by reviewing locally-constructed 
instruments, analyzing all data , preparing the final report, 
and overseeing the operation of the entire evaluation. 

The evaluation of this bilingual project focused on the 
assessment of each individual objective of the project in 
each project component. Additional data were gathered which 
could be used as baseline data for comparing future projects 
and project groups to current project groups. These additional 
data included standardized achievement scores, evaluation of 
workshops by their participants, and infonnation from a socio- 



logical data questionnaire completed by parents of program 
participants. 



The following activities were involved in the evaluation 
of the St. John Valley Bilingual Program for 1970-71. 

1. Measurement of students' cognitive achievement with 

the following standardized tests : Metropolitan 

Readiness Test, Common Concepts Foreign Language 
Test - French version, Michigan Oral Language 
Productive Test, Meeting Street School Screening 
Test, and Metropolitan Achievement Test, 1970 
edition. 

2. Construction and administration of teacher-made 
tests to assess each product objective of the 
instructional component. 

3. Monitoring of instructional process objectives by 
the teachers’ completion of daily process check- 
lists. 

4. Daily verbal feedback by the on-site evaluator to 
the project director; written monthly feedback to 
the teachers about the status of instructional 
process objectives through tabulation and reporting 
of process checklist responses. 

5. Written report of pre-test results for all in- 
structional objectives and achievement tests. 

6. Construction and administration of instruments to 

assess each objective in the non-instructional . 
components. • 

7. Construction, administration, and analysis of 
questionnaires for each in-service workshop. 

8 . Preparation of an interim evaluation report for 
inclusion in the continuation proposal. 

9. Formal and informal interviews with all staff 
members . 

. .Observation of classes by the on-site evaluator. 
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The results of the evaluation are presented in two parts 
in this report. Part I summarizes for each component the 
status of the accomplishment of the first year program goals. 
Part II discusses the evaluation of each specific program 
objective and its status of accomplishment at the end of the 
program. Part II also presents the results of additional 
data gathered on the particular project components. It also 
includes commendations and recommendations for each project 
component . 



PART I 



SUMMATIVE EVALUATION OF FIRST YEAR GOALS 
BY PROJECT COMPONENT 



INSTRUCTIONAL COMPONENT: SUMMARY 

Standardized Testing Results 

A series of standardized tests was administered to 
selected program participants. These tests included the 
Metropolitan Readiness Test to measure readiness skills for 
the kindergarten students, the Common Concepts Foreign 
Language Test - French Version to measure aural ability in 
French, the Michigan Oral Language Productive Test to assess 
fluency in English as a first' language, the Meeting Street 
School Screening Test to measure ability in visual-perceptual- 
motor and language skills, and the Metropolitan Achievement 
Test, 1970 Edition, Primary Level to measure reading and mathe- 
matics achievement for the grade one students. 

The results on each of these tests, for the most part, 
indicate a wide range of ability among the program participants 
The scores suggest a population which is heterogeneous in 
ability in the various skills measured by these tests. A more 
specific reporting of the results of achievement tests is in- 
cluded in Part II of this report. 

Kindergarten: First Year Goals 

The following is a listing of the first year goals for the 
kindergarten students. 



1 . 



Kindergarten children will demonstrate competence in 
the skills of reading readiness. 

2. Kindergarten children will demonstrate improvement in 
their psychomotor skill development. 

3. Kindergarten children will understand basic number 
concepts . 

4 . Kindergarten children will use patois French as 
an acceptable language and begin to use standard 
French in formal speech . 

5. English-speaking kindergarten children will demon- 
strate basic oral communication skills in French. 

Tables 2 through 6 demonstrate the status of each objective 
which relates to the first year goals for kindergarten children. 
For those objectives which were measured during both the pre- 
and post-testing, Tables 2 through 6 indicate whether the 
criterion specified in the objective was met on the pre-test 
and/or on the post-test. In addition, a notation is made if a 
significant difference existed between the pre-test and post- 
test scores . For those objectives iwhich were post-tested only , 
an indication if the criteria specified in the objective was 
met on the post-test is included in Tables 2 through 6. 

Goal 1 : Kindergarten Children Will Demonstrate Competence 

in the Skills of Reading Readiness . 

Ten kindergarten objectives were directed toward the 
accomplishment of this first- year goal. Nine of these ten 
objectives were accomplished by the program participants by 



the end of the kindergarten year. Table 2 indicates the 
specific status of each objective. 



TABLE 2 

Accomplishment Status of Kindergarten 
Reading Readiness Objectives 



Objective Was Criterion Met? Significant Difference 

Pre Post (NS-Not Significant) 

(* - Significant) 



K-l.lJ- 


No-Yes 


Yes 


NS - 


* 


K-1.2* 


No-Yes 


Yes 


NS - 


* 


K-1.3 1 


No-Yes 


Yes 


NS - 


* 


K-1.4 


Yes 


Yes 


NS 




K-1.5 


Yes 


Yes 


NS 




K-1.6 


No 


No 


NS 




K-1.7 


Yes 


Yes 


* 




K-1.8 


Yes 


Yes 


NS 




K-1.9 


Yes 


Yes 


NS 




K-l . 10 


Yes 


Yes 


NS 




1 - More 


than one test 


administered 


to measure objective 


Table 


2 indicates 


that the kindergarten students had 



mastered the following reading readiness skills at the criterion 
specified in the appropriate objective: visual perception 

(K-l.l) , auditory perception (K-1.2), word recognition (K-1.3), 
pronunciation of Dolch basic words (K-1.4), pronunciation of 
words in pre^primers (K-1.5), identification of main characters, 
main ideas, and conclusion in a story (K-1.7) , sequencing of 
activities in a story (K-1.8) , repetition of a five-word English 
sentence (K-1.9), and creation of endings for simple stories 
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in English (K-1.10). Students did not satisfactorily accom- 
plish the skill of associating nouns and verbs with their 
corresponding pictures (K-1.6); therefore, this objective of 
the program was not accomplished. It is important to note, 
howevef, as stated in Table 2, that many of these objectives 
were accomplished at the pre-testing . 

This situation suggests that the objectives may be in- 
appropriate for the students because they possessed skills 
specified in the objectives before entering kindergarten. Or 
the pre-testing in October and November occurred too late in 
the program after some of the skills had already been taught. 

A thir d possibility is that the criterion levels specified 
for a majority of the objectives were not appropriate. However 
the fact that no significant difference exists between the 
test scores for the majority of these reading readiness objec- 
tives seems to eliminate this possibility. The evaluators 
recommend that a review of these possible explanations be made 
and appropriate changes implemented. 

Goal 2 : Kindergarten Children Will Demonstrate Improvement 

in their Psychomotor Skills Development . 

Table 3 presents the status of those objectives in the 
bilinqual program which were directed toward the acquisition 
of psychomotor skills. 



TABLE 3 



Accomplishment Status of Kindergarten 
Psychomotor Skills Objectives 



Objective 


Was Criterion Met? 
Pre Post 


Significant Difference 
(NS-Not Significant) 
(* - Significant) 


K-2.1 


No 


Yes 


NS 


K-2.2 


No 


No 


NS 


K-2.3 


No 


Yes 


NS 


K-2.4 


No 


No 


* 


K-2.5 


No 


No 


NS 


K-2.6 


No 


No 


NS 


K-2.7 


Yes 


Yes 


NS 



The results shown in Table 3 suggest the participation 
in the bilingual program had a limited impact on the kinder- 
garten students acquisition of psychomotor skills. Only three 
o£ seven objectives related to this skill area were accompli- 
shed. In addition, the results of testing for only one 
objective showed a significant difference between the pre-test 
and post-test scores. Yet, unlike the reading readiness skills 
the majority of the psychomotor objectives were not accompli- 
shed at the time of the pre-testing. These results suggest 
that a restructuring of the psychamotor objectives might be 
appropriate. A review of their appropriateness for kindergarten 
children, of the frequency of the process used to accomplish 
them, and of the appropriateness of the criterion level should 
be made. Specific reference to Part II of this report will 



indicate the processes directed toward the accomplishment of 
each of these objectives . 

During the course of the program the students seemed to 
sufficiently develop the following psychomotor skills to satisfy 
the corresponding performance objective: tactual perception 

(K-2.1), perceptual constancy skills (K-‘2.3 ), and fine motor 
coordination skills (K-2.7). In addition, participation in 
the program seems to have significantly effected growth in 
spatial relationship skills (K-2.4). In order to develop such 
skills as visual perception (K-2.2), sense of smell (K-2.5), 
and gross motor skills (K-2.6), more intense instruction must 
be focused on these particular psychomotor objectives. 

Goal 3 ; Kindergarten Children Will Understand Basic Number 
Concepts 

The results shown in Table 4 indicate that, with the 
exception of one objective directed toward this goal, the 
pre-test scores of the kindergarten participants on measures 
of number concepts were below the criterion levels specified 
in the number concepts objectives. Table 4 indicates that 
five of the objectives which focused on acquisition of number 
concepts, had been accomplished by the end of the program year. 
In order to accomplish the specific program objectives, the 
students mastered the following skills: orally assigning the 

name of a number to a visual representation of the number 



TABLE 4 



Accomplishment Status of Kindergarten 
Number Concepts Objectives 



Objective 


Was Criterion Met? 
Pre Post 


Significant Difference 
(NS-Not Significant) 
(* - Significant) 


K-3.1 


No 


No 


* 


K-3.2 


Yes 


Yes 


* 


K-3. 3 


No 


Yes 


NS 


K-3 . 4 


No 


No 


* 


K-3. 5 


No 


Yes 


* 


K-3. 6 


No 


No 


NS 


K-3.7 


No 


Yes 


* 


K-3. 8 


No 


No 


* 


K-3. 9 


No 


Yes 


* 


K-3. 10 


No 


No 


* 


K-3. 11 


No 


No 


* 



(K-3.2), understanding the number concepts 0 through 10 
(K-3. 3), orally naming the number of objects in a combination 
of two sets (K-3. 5) , naming a particular shape and selecting 
identical shapes from a group (K-3.7), and differentiating the 
sizes, shapes, and weights of different objects (K-3. 9). The 
remaining objectives were not accomplished; these involved the 
skills of placing identical members of a set in a one to one 
correspondence (K-3.1) , drawing the next object in a series 
of numbers (K-3.4), removing a stated number of objects from 
a set and naming the remaining set (K-3. 6), orally naming a 
particular geometric shape (K-3. 8), orally stating the correct 
time to the hour (K-3. 10) , and orally identifying the name of 
several coins (K-3. 11). 
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Table 4 states, however, that £or nine o£ the eleven 
number concepts objectives a significant difference existed 
between the pre-test and post-test scores. These results 
suggest that participation in the bilingual program classes 
had a significant impact on the students' knowledge of parti- 
cular number concepts. The data analyses further imply that 
the specific criterion levels for the individual objectives 
mi ght not be appropriate for many of the objectives, e.g. K-3.1, 
3.2, 3.4, 3.8, 3.10, arid 3.11. The evaluators recommend that 
a review of these particular objectives be made before the 
next program year, and appropriate adjustments considered and 
implemented. In addition, reference to the process used to 
accomplish each of these objectives should be noted and its 
appropriateness determined. 

Goal 4 ; Kindergarten Children Will Use Patois French as an 

Acceptable Language and Begin to Use Standard French 
in Formal Speech 

e 

Four particular program objectives were directed toward 
this first-year general program goal for kindergarten children. 
Table 5 summarizes the results of the performance of the 
students on these objectives. 

Tfeble 5 indicates that the program had limited success 
in accomplishing the objectives related to use of French as 
a first language in the classroom. Only one of four objec- 

20 i6 



TABLE 5 



Accomplishment Status o£ Kindergarten 
French as a First Language Objectives 



Objective 


Was Criterion Met? 
Pre Post 


Significant Difference 
(NS -Not Significant) 
(* - significant) 


K-4.1 


Yes 


Yes 


* 


K-4.2 


No 


No 


NS 


K-4.3 


No 


No 


' * 


£-4.4 


No 


No 


* 



tives was accomplished: that students would demonstrate a 

comfortableness with French in the classroom (K-4.1). The 
remaining objectives, which focused on demonstration of stan- 
dard expression and pronunciation (K-4.2) , French vocabulary 
recognition (K-4.3) , and ability to read basic French words 
(K-4.4), were not accomplished as specified in the project 
plan. However, for two of these objectives, that a significant 
difference existed between the pre-test and post-test scores, 
suggests that perhaps the criterion level specified in the 
objectives was not appropriate, and that the program may have 
had some impact on the development of these skills. The pro- 
gram seemed to have limited impact on the ability of the 
students to demonstrate standard expression and pronunciation 
(K-4.2), because the objective was not accomplished nor did a 
significant difference exist between the pre-test and post- 
test scores. Discussion with program staff indicated their 
recognition of French instruction in the classroom as one 



songs and playing games. Since no pre-test measures of these 
objectives were administered, exact impact of the students' 
participation in the program on their ability to understand 
and perform French commands or to orally identify French 
vocabulary words cannot be determined. The results on the 
Common Concepts Foreign-Language Test-French Version , however 
indicate that no significant difference existed between the 
pre-test and post-test scores for the monolinqual English 
kindergarten students in their ability to comprehend spoken 
French; this suggests the program had limited impact on the 
English participants' knowledge of French. 

Goal 6 : Kindergarten Children Will Have Knowledge of the 

Valley ' s Acadian Culture . 

Table 7 summarizes the status of the three objectives 
directed toward an acquisition of knowledge about Acadian 
Culture . 

TABLE 7 

Accomplishment Status of Kindergarten 
Knowledge of Acadian Culture Objectives 



Objective Was Criterion Met? Significant Difference 

Pre Post (NS-Not Significant) 

(* - Significant) 



K-6.1 


- 


Yes 


Post only 


K-6 . 2 


— 


Yes 


Post only 


K-6.3 


No 


No 


NS 



Table 7 summarizes the results of the testing of the 
Acadian Culture objectives. The students mastered the 
ability to sing French songs and play French games (K-6.1) 
and to orally tell a story about a historical event or 
personality related to the Valley's history from a series of 
pictures (K-6.2). The student did not master the ability 
to identify at least three landmarks of the Valley area 
(K-6.3), a skill on which participation in the program had 
limited effect because there was no significant difference 
between the pre-test and post-test scores. A review of the 
process directed toward acquisition of knowledge about Acadian 
Culture reveals that limited instruction was devoted to this 
area of the curriculum. More specific details about the 
frequency of process activities are available by referring 
to Part II of the evaluation report. 

Grade One; First Year Goals 

The following list describes the first year goals for the 
grade one students in the St. John Valley Bilinqual Project: 

1 . First grade students will exhibit growth in their 
mastery of language art skills. 

2. First grade children will understand and apply 
basic mathematics skills. 

3. First grade children will use patois French as 
an acceptable language and begin to use standard 
French in formal speech. 

4. English-speaking first grade children will 
demonstrate basic oral communication skills in 
French. 

5. First grade children will have knowledge and 
appreciation of the Valley's Acadian Culture. 



Tables 8 through 12 summarize the accomplishment status 
of the specific objectives directed toward the first year 
goals for the grade one students. 

6°al 1 : First Grade Students Will Exhibit Growth In Their 

Mastery of Language Arts Skills 

Table 8 describes the program's impact on the accomplish** 
ment of language arts objectives for the grade one student. 

TABLE 8 

Accomplishment Status of Grade One 
Language Arts Objectives 



Objective Was Criterion Met? Significant Difference 

Pre Post (NS-Not Significant) 

(* - Significant) 



1-1.1 










1-1.2 


No 


Mo 




* 


1-1.3 


No 


Mo 




* 


1-1.4 


No 


Mo 




* 


1-1.5 


No 


Mo 




* 


1-1.6 


No 


Mo 




NS 


1-1.7 


No 


Yes 




MS 


1-1.8 


No 


Mo 




MS 


1-1.9 


No 


Mo 




MS 


1-1.10 


Yes 


Yes 




* 


1-1.11 


No 


Mo 




MS 



Of the eleven objectives directed toward the acquisition 
of language;, art skills, only two objectives were accomplished 
by the program. The objectives focused on the ability of 
students to pronounce words involving ending sounds "ed , " 
"ing," and "s" (1-1,7) and on their ability to perform a series 



of comprehension skills (1-1.10) . This latter objective had 
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been accomplished on the pre-test, as well as on the post-teat 
although a significant difference existed between the pre-test 
and post-test scores. For a second group of objectives the 
required criterion level was not met on the post-test, but 
a significant difference did exist between the pre-test and 
post-test scores. This pattern of results suggests that, 
although participation in the program had some impact on 
the acquisition of skills in this group of objectives, the 
criterion level specified in each particular objective may 
not have been appropriate. This group of objectives in- 
cluded those related to the acquisition of the following 
skills: ability to pronounce words common to pre-primers 

(1-1.2), to pronounce words with particular initial con- 
sonants (1-1.3) , to correctly name words with particular 
final consonants (1-1.4), and to correctly name words with 
particular middle consonants (1-1.5). Participation in 
the program seems to have no impact on the students' ability 
to correctly pronounce words using particular initial con- 
sonant blends (1-1.6) , to correctly pronounce a series of 
compound words given a visual stimulation (1-1.7) t to 
pronounce a series of word families (1—1.8) , and to demon- 
strate particular oral and silent reading skills (1-1.9). 

It should be noted that, although some students could 
perform each of these language arts objectives, a suffic- 
ient number of students to satisfy the criterion specified in 
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the particular objectives could not perform the skill. These 
results suggest that a review of the appropriateness of the 
criterion level established for each of the language arts 
objectives and of the processes used to accomplish these 
objectives should be made. 

— * First Grade Children Will Understand and Apply 
Basic Mathematics Skills. 



TABLE 9 

Accomplishment Status of Grade One 
Mathematics Skills Objectives 



Objective Was Criterion Met? Significant Difference 

Pre Post (NS-Not Significant) 

(* - Significant) 



1-2.1 


No 


Yes 


* 


1-2.2 


Yes 


Yes 


NS 


1-2.3 


No 


No 


* 


1-2.4 


Yes 


Yes 


* 


1-2.5 


No 


Yes 


* 


1-2.6 


Yes 


Yes 


/ * 


1-2.7 


No 


Yes 


*. 


1-2.8 


Yes 


Yes 


* 


1-2.9 


No 


No 


* 


1-2.10 


No 


Yes 


* 


1-2.11 


No 


No 


* 


1-2.12 


No 


No 


NS 


1-2.13 


No 


No 


* 


1-2.14 


No 


Yes 


* 


1-2.15 


No 


No 


* 


1-2.16 


NO 


No 


* 


1-2.17 


No 


No 


* 


1-2.18 


No 


No 


* 


1-2.19 


NO 


No 


* 







Table 9 indicates that the first grade program had 
varied success in meeting the particular mathematics skills 
objectives specified in its curriculum. By the end of the 
program students had accomplished objectives related to the 
following mathematics skills: differentiation between 

equivalent and non-equivalent sets (1-2.1) , association of 
number symbols with a set of objects (1-2.2) , writing and 
recognizing of the numbers 0 to 100 (1-2.4) , understanding 
of the concepts 1/2 and 1/4 (1-2.5) , orally reading the 
ordinal numbers 1 to 20 (1-2.6) , using a number line to show 
number sequence (1-2.7), combining sets of objects up to 12 
(1-2.8) , accurately adding columns with 3 addends yielding 
sums through 12 (1-2.10), and accurately subtracting zero 
from a number and a number from itself (1-2.14) . Xt should 
be noted that reference to Table 9 indicates that the pre- 
test status of many of these objectives varied. 

A significant difference existed between the pre-test 
and post-test scores for all but two objectives, suggesting 
that the program had some impact on the acquisition of the 
following skills: orally counting from 0 to 100 (1-2.3), 

adding two numbers in horizontal and vertical form (1-2.9), 
adding three two-digit addends with no remaining (1-2.11) , 
using. the number line for addition (1-2.13), subtracting two 
digit numbers with no regrouping (1-2.15), measuring line 
fragments of foot, inch, and half-inch (1-2.16), disting- 



uishing pints and quarts (1-2.17) , recognizing the time con- 
cepts of day, week, month, and year (1-2.18), and using the 
time concept of hour and half-hour (1-2.19). 

Participation in the project classes seemed to have no 
effect on the students' acquisition of the concept cited in 
objective 1-2.12, adding two two-digit addends with no 
remaining using expanding notation, and of that cited in 
objective 1-2.2, associating number symbol with the set of 
objects, although the criterion in this latter objective was 
reached . 

The results of the assessment of objectives related to 
mathematics skills suggest that a review of the criterion 
levels specified in these objectives and of the processes 
used to accomplish many of the objectives should be made to 
make them most appropriate for the population. Because 
for some objectives the criterion was met on both the pre- 
test and post-test and for others which were not accomplished 
at either testing a significant difference existed between 
the pre-test and post-test scores, a strong possibility 
exists that the criterion levels specified in the objectives 
are inappropriate. 



Goal 3 : First Grade Children Will Use the Patois French 



as an Acceptable Language and Begin to Use Standard 
French in Formal Speech . 

Table 10 displays the results of the objectives related 
to the learning of French as a first language. 

TABLE 10 

Accomplishment Status of Grade One 
French as a First Language Objectives 



Objective 


Was Criterion Met? 
Pre Post 


Significant Difference 
(NS -Not Significant) 
(* - Significant) 


1-3.1 


No 


No 


NS 


1-3.2 


No 


No 


* 


1-3.3 


No 


No 


* 


1-3.4 






Not Measured 



The results summarized in Table 10 indicate that none 
of the four French as a first language objectives were 
accomplished by the project classes. (Due to an evaluative 
oversight no measurement of objective 3.4 was made). The 
program did seem to have some impact, however, on the 
students' ability in two of these FSL skill areas, demon- 
stration of standard expression and pronunciation (1-3.3) 
and French vocabulary recognition (1-3.3). In addition, as 
noted previously, a significant difference existed between 
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the pre-test and post-test scores on the Common Concepts 
Foreign Language Test - French Version for the French-dominant 
students. Participation in the program had no measurable 
impact on their conf or tableness with French in the classroom 
(1-3.1). These results suggest that a review of the French 
as a first language objectives should be made. Confirmation 
of this recommendation was made in comments by teachers and 
other members of the project staff. These professionals 
especially noted the need for a French specialist to provide 
additional materials in French and direction in teaching 
French as both a first and a second language. 

Goal 4 ; English-Speaking First Grade Children Will 



The acquisition of French skills by the English mono- 
lingual student was measured only at the end of the program. 
Table 11 summarizes the results of this assessment. 

Table 11 indicates that the objectives relating to com- 
prehension of simple classroom commands and procedures (1-4.1) 
and to oral identification of French vocabulary words (1-4.3) 
were accomplished by the program's participants . The program 
at the first grade level did not accomplish the French as a 
second language objective relating to the students ' ability 
to sing three French songs and play three French games (1-4.2). 
A precise determination of the exact impact of participation 



Demonstrate Basic Oral Communication Skills in 



French 
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TABLE 11 

Accomplishment Status of Grade One 
French as a Second Language Objectives 



Objective Was Criterion Met? Significant Difference 

Pre Post (NS-Not Significant) 

{* - Significant) 



1-4.1 


- 


Yes 


Post only 


1-4.2 


- 


No 


Post only 


1-4.3 


- 


Yes 


Post only 



in the program on these objectives cannot be made because 
the objectives were not pre-tested. Based on discussions 
with project staff it might be assumed that the students 
possessed no knowledge of French when they entered the class- 
room, and, thus, their performance on objectives 1-4.1 and 
1-4.3 were the direct result of their participation in the 
program. In addition, the significant difference between 
pre-test and post-test scores of the monolingual English 
students on the Common Concepts Foreign Language Test - 
French Version implies that these students gained some know- 
ledge of French during the course of the year. 

Goal 5 : First Grade Children Will Have Knowledge and 

Appreciation of the Valley's Acadian Culture 

Of the three first grade curriculum objectives which 
relate to acquisition of knowledge about Acadian Culture, 



TABLE 12 



Accomplishment Status of Grade One 
Knowledge of Acadian Culture Objectives 



Objective 


Was Criterion Met? 
Pre Post 


Significant Difference 
(NS-Not Significant) 
(* - Significant) 


1-5.1 


— 


Yes 


Post only 


1-5 • 2 


— 


No 


Post only 


1—5 • 3 


No 


No 


* 



the program students accomplished that objective which 
required them to sing three French songs and play three 
French games (1-5.1). They did not accomplish the objec- 
tives which required them to tell a story about a historical 
event or person in the Valley's history from a series of 
pictures (1-5.2) and to identify at least three landmarks of 
the Valley area (1-5.3). A significant difference did exist, 
however, between their pre- and post-test scores on the 
identification of Valley landmarks. The program seems to 
have positively affected this skill, although not at the 
level specified in the objective. A review of the processes 
used to accomplish these objectives and a discussion with 
classroom teachers indicate that an insufficient amount of 
time was spent on teaching these skills; this most likely 
explains the failure of students to accomplish the majority 
of Acadian Culture objectives. 



STAFF DEVELOPMENT COMPONENT: SUMMARY 



The following is a list of the first year goal:* of the 
Staff Development Component of the St. John Valley Bilingual 
Project : 

1. The project staff will display an openness and 
willingness to work with other staff members , 
community, consultants, and administration in 
producing educational change to a bilingual 
program. 

2. The project staff will be able to teach English 
as a second language. 

3. The project staff will be able to teach French 
as a first language. 

4. The project staff will be able to state performance 
objectives and have a favorable attitude toward 
them. 

5. A cadre of aides will be developed who can assist 
the teachers in the classroom. 

Table 13 summarizes the accomplishment status of both the 
product and process objectives of the staff development com - 
ponent. 
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Goal 1: 



The Project Staff Will Display an 0penne33 and 
Willingness to Work with Other Staff Members , 

Community, Consultants, and Administration in 
Producing Educational Change to a Bilingual Program 

Objectives SD-1.1, SD-1.2 and SD-1.3 were specified as a 
means to accomplish this first year goal . The status of these 
objectives summarized in Table 13 suggests that this first 
year goal was accomplished because each of the three product 
objectives directed toward it was accomplished. Their 
accomplishment means that the director displayed an openess 
and willingness to work with others in the project to produce 
educational change (SD-1.1), the Title VII project director, 
executive committee, Title III project director, and Title 
VII curriculum specialist demonstrated an ability to work 
together (SD-1.2), and the director and his staff demon- 
strated an ability to work together (SD-1.3). 

Since the product objectives were accomplished, it is 
most likely that the processes used to accomplish them were 
appropriate. As expected, two of the process objectives 
related to this first year goal were accomplished: the project 

director will participate in a human relations laboratory 
(SD-1.1P), and the project staff will participate in the needs 
assessment laboratory (SD-1.3P) . The process which specified 
that a fellow of NTL will conduct a sensitivity laboratory 



for the executive committee, the Title VII project director, 
the Title III project director, and the curriculum specialist 
was not performed. In spite of this, its corresponding pro- 
duct objective was met. The project director reported, how- 
ever, that a need for this process activity still exists; he 
hopes to include it in the 1971-72 program . 

Goal 2 1 The Project Staff Will be Able to Teach English as 
a Second Language 

No progress was made toward this goal during the 1970-71 
project year, as shown in the status of staff development 
objective 2.1 in Table 13. Because of the late start of the 
program, no pre-service or in-service courses were provided 
for teaching English as a second language. The project 
staff reported staff training in teaching English as a 
second language should receive a high priority for inclusion 
in the 1971-72 program. 

Goal 3 ; The Project Staff Will be Able to Teach French as 
a First Language . 

Table 13 indicates that product objective 3.1, "the 
teachers will demonstrate an increased skill in teaching 
French as a first language," was accomplished. The process 
used to accomplish this objective was quite similar to that 
stated in the original project plan. In-service courses in 
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teaching French as a first language were provided , although 
no pre-service course was provided. Furthermore, the teachers 
maintained the 90% attendance specified in process objective 
SD-3.1P. 
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A review of the status of accomplishment of the instruc- 
tional objectives related to teaching of French as a first 
language, however, suggests that more energy should be directed 
to this part of the program. Because the teachers did not 
complete this training in teaching French as a first language 
until the end of the 1970-71 program, it is quite possible 
that the impact of this training will not be felt until the 
1971-72 program. 

Goal 4 ; The Project Staff Will be Able to State Performance 
Objectives and Have a Favorable Attitude toward 
Them 

This project goal was not accomplished during the 1970-71 
program because, as shown in Table 13, SD-4.1 was not accomp- 
lished during the program year . The teachers did not achieve 
the criterion level established for the test at the end of 
Preparing Instructional Objectives by R.F. Mager. Some attempt 
was made to help the teachers accomplish this objective by pro- 
viding them with Mager' s text, although this process did not 
seem to be sufficient for the accomplishment of the objective. 
The project director reports that plans exist for using the 
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Vimcet Series on behavioral objectives as the process to attain 
this goal during the next program year. 

Goal 5 : A Cadre of Aides Will be Developed Who Can Assist 

the Teacher in the Classroom 

Objectives 5.1 and 5.2 in Table 13 indicate that those 
objectives related to the participation and functioning of 
aides in the bilingual program were accomplished. Both 
product and process objectives were met. Therefore, the 
teacher aides contributed significantly .to classroom oper- 
ations (SD-5.1) , and a majority of the aides participated in 
professional development courses (SD-5.2). In addition, pre- 
service courses were provided for the aides in the necessary 
clerical and managerial skills required by the job (SD-5.1P) 
and the program staff encouraged the aides to attend profes- 
sional development courses (SD-5.2P) , goal 5 of the Staff 
Development Component was accomplished. 



COMMUNITY COMPONENT: SUMMARY 

The Community Component of the St. John Valley Bilingual 
Program had a series of specific product and process objec- 
tives which focused on the following first year goals: 

1. An Advisory Council will be formed which will assist 
the project in policy- formation and decision-making. 
The council will consist of businessmen , educators , 
parents, clergy, and students. 

2. Valley residents will be informed of the Bilingual 
Program through the local media. 

3. Parents will become actively involved in the project's 
operations . 

4. Parents will support the Bilingual Program. 

5. The project will establish a working relationship 
with Ft. Kent State College. 

Table 14 summarizes the accomplishment status of the 
Community Component objectives. 



Goal 1 : 



An Advisory Council Will be Formed Which Will 
Assist the Project in Policy Formation and 
Decision-Making. The Council Will Consist of 
Businessmen , Educators, Parents, Clergy , and 
Students . 

Reference to Table 14 indicates that objectives 1.1 and 
1.2 were accomplished; therefore, an Advisory Council was 
formed which consisted of businessmen, educators, parents, 
clergy, and students (C-l.l), and which contributed to the 
program by making at least two suggestions that were accepted 
and incorporated into it (C-1.2). The first objective was 
accomplished by the originally anticipated process of in- 
forming the community of the opportunity to participate in 
the advisory group by letter and direct personal contact 
(C-1.1P) . The second objective was accomplished by a 
partial performance of the anticipated process, that of 
holding Advisory Council meetings at least monthly during 
the year; some Advisory Council meetings were held although 
less frequently than once a month. The number of meetings 
which were held, however, seems to be satisfactory for the 
accomplishment of the corresponding product objective. 





\ 





Goal 2 ; Valley Residents Will Be Informed of the Bilingual 
Program through the Local Media , 

Information was disseminated to residents of the Valley 
through the local English-speaking newspapers and through a 
monthly bilingual bulletin which was published by the program 
in French and English. Information about project activities 
was also disseminated in the Valley through the participation 
of the Project Director and staff members in radio discussions 
and television programs. The goal that Valley residents would 
be informed about the project was accomplished. 

Goal 3 : Parents Will Become Actively Involved in the 

Pro j ect s 1 Operation . 

Objectives 3.1, 3.2, and 3.3 included in Table 14 relate 
to parental involvement in the Bilingual Program. Although 
some parental involvement occurred, it could not occur to 
the degree anticipated at the beginning of the project year. 

No parent aide program was initiated (C-3.1) because of the 
late beginning of the Bilingual Program. Some parents 
visited the school at least twice a year, but not the 60% 
originally expected (C-3.2). The objective which stated 
that at least 50% of the parents would attend at least one 
meeting of the PTA group (C-3.3) was accomplished, although 
the process used to accomplish it was begun slightly later 
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them anticipated. Although some degree of parental involve- 
ment in the program occurred, during 1970-71, an emphasis 
in increasing involvement should be part of future programs. 

Goal 4 : Parents Will Support the Bilingual Program . 

In Table 14 the accomplishment of objective 4.1 indicates 
that the project had the support of the parents. An attitude 
questionnaire was used to measure the parents' enthusiasim for 
the program. The original evaluation plan required the parents 
to complete two questionnaires to demonstrate a significant 
improvement in their attitude toward the program. However, 
their highly positive response to the questionnaire admin- 
istered in December prevented any improvement in their attitude 
from occurring. The goal of obtaining the parents' support 
for the bilingual program was accomplished. 

Goal 5 : The Project Will Establish a Working Relationship 

with Ft. Kent College . 

One product and one process objective were directed toward 
the accomplishment of this goal; both were accomplished during 
the program year. The project director invited personnel from 
Ft. Kent State College to visit and participate in the program. 
The contact with Ft. Kent was initiated in the fall, 1970. 
Participation from Ft. Kent College occurred in the areas of 



in-service training and materials development. This fifth 
goal of the Community Component was accomplished during the 
first program year. 



MATERIALS DEVELOPMENT COMPONENT: SUMMARY 



The Materials Development Component involved ten specific 
product and process objectives which were directed toward the 
accomplishment of the first year goals for this component. 
Additional activities were performed that were not stated in 
these objectives, although the majority of the component 
activities focused on the particular product objectives. The 
first year goals for the Materials Development Component were 



1. Project staff will investigate available bilingual 
French materials and cultural materials. 

2. Project staff will investigate available ESL 
materials. 

3. Project staff will select and begin to develop 
appropriate French, cultural and ESL materials 
suited to the project's objectives. 



Table 15 summarizes the status of the product and process 
objectives of the Materials Development Component at the end 
of the 1970-71 project year. 
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Goal 1 : Project Staff will Investigate Available Bilingual 

French Materials and Cultural Materials . 

Four objectives were directed toward the accomplishment 
of this goal, which focused on the investigation of already 
existing materials which could be useful for the St. John 
Valley Bilingual Program. Reference to Table 15 indicates 
that two product objectives involving the investigation of 
already existing materials were accomplished. One objective 
wa$ not accomplished; and one objective could not be accomp- 
lished. Establishment of a working relationship between the 
project director, curriculum specialist, and the Title III 
project director, collecting of some Title III materials, and 
meeting with the Title III director occurred (MD-1.1) . Also, 
Written contacts were made with several bilingual projects in 
Canada, and personal contracts were made with the St. Lambert 
Project and some schools in Edmundston, New Brunswick, Canada 
(MD-1.2). The curriculum specialist did not collect any 
materials from the follow-through projects in Maine (MD-1.3) 
because no materials were available. In addition, a bilingual 
consortium for French materials was not established because 
additional funds required for it were not given to the St. 

John Valley Bilingual Project (MD-1.4) . All process objective 
were accomplished as stated, with the exception of a failure 
to include a written report on the trip to Greenville in the 
project files. In general, however, the goal of investigating 








bilingual and French materials was accomplished during this 
first program year. 

Goal 2 : Project Staff Will Investigate Available ESL 

Materials . 

Reference to objective 2.1 in Table 15 indicates that 
the goal of investigating ESL materials was accomplished. 

Both the product objective of contacting at least six other 
bilingual projects in their second year of operation and 
gathering ESL materials from them and the process activity 
of including a list of these projects in the file were 
accomplished. 

Goal 3 ; Project Staff Will Select and Begin to Develop 
Appropriate French Cultural and ESL Materials 
Specific to the Project's Objectives . 

Five specific program objectives were directed toward 
the selection and development of materials for the St. John 
Valley Bilingual Program. Two of these objectives were ac- 
complished as stated in the original set of objectives; the 
project director and curriculum specialist reviewed project 
objectives with the staff to determine those which were 
attainable with available materials (MD-3.2), and a materials 
development team developed at least six tapes of stories in 
French and English for K-l (MD-3.3). For one objective 
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(MD-3.1), different activities from those originally planned 
occurred. Instead of reviewing in writing materials collected 
in terms of program objectives, another procedure was imple- 
mented to review materials’; the teachers used the materials 
in the classroom and then orally identified for the curriculums 
director the useful and appropriate materials. Two objectives 
were partially accomplished: the production of language 

master cards as needed for the performance objectives (MD-3.5) 
and the recording of twelve French songs and games for K-l 
children (MD-3.6) . Language master cards were developed by 
the individual teachers as required for classroom activities; 
the materials development team developed, them only for Barbe 
and Dolch words. Objective MD-3.6 was only partially accomp- 
lished because fewer than twelve songs and games are recorded 
in the project files. 



Process activities specified as a means of accomp- 
lishing the product objectives directed toward first year ' 

goal 3 were performed as stated. Materials development j 

te ams were organized to function in the areas of Acadian .j 

Culture, French song development, and development of lan- j 

t' 

guage master cards. The teams did not operate, however, | 

during the entire year. This lack of full-year operation j 

\ 

may explain the partial accomplishment of some of the objec- | 

J 

tives directed towards this materials development goal . The I 

1 

project staff also noted the need for a French specialist 
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who would direct the development of French materials. The 
staff felt that the present curriculum coordinator should 
focus on the development of ESL materials during the 1971-72 
project year. 
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MANAGEMENT OBJECTIVES: SUMMARY 

» 

The management of the St. John Valley Bilingual' Program 
was organized into several management areas: position 

qualifications and responsibilities , organization, planning, 
reporting, and communication-coordination-dissemination. A 
review of the overall management of the program reveals a 
highly efficient and effective administration of the program. 
For the most part, management objectives were accomplished 
on schedule. 

Position Qualifications and Responsibilities 

This aspect of management involved the selection of the 
project director, curriculum coordinator, and evaluator and 
the performance of duties by these three individuals. A 
review of the credentials of these three people indicated 
that they possessed the appropriate qualifications for their 
positions. They also performed all duties required of them. 

Organization 

The organization objectives focused on the delegation of 
the appropriate lines of authority to the Board of Directors, 
Advisory Council, SAD #33 Board of Directors, program teachers 
and program aides. A review of the credentials of each of 
these groups indicated that all groups and individuals 



possessed the qualifications required for their positions. 

All individuals performed the duties required of them. 

Planning 

Table 16 indicates that, with the exception of five 
management planning objectives , this aspect of management was 
accomplished on schedule. Management objectives 2 and 3, 

Table 16 

Accomplishment Status of 
Management (Planning) Objectives 



Accomplished 
On Time 


Accomplished 

Late 


Not 

Accomplished 


1 


16 


2 


10 


4 


17 


3 . 


14 


5 


18 




26 


6 


19 






7 


20 






8 


21 






9 


22 






11 


23 






12 


24 






13 


25 






15 


27 







scheduling parent meetings in the three districts and forming 
the Advisory Council were accomplished later than scheduled. 
The three management objective which were not accomplished, 
numbers 10, 14, and 26, involved scheduling meeting of local 
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advisory councils once a month, beginning an in-service 
training on teaching English as a second language, and 
conducting a second parent visit to school respecitively . 

For the most part, however, the planning objectives of the 
Project Management were accomplished on time. The project 
manager should be highly commended on this accomplishment. 

Reporting 

All but three reporting objectives were performed on 
schedule. Only the reports on the evaluation of the in-service 
program from October 6-12, the baseline data, and the evalu- 
ation of classroom activities and teachers aides were sub- 
mitted late (at most one month later than scheduled) . 

Communication- Coord i nation- Dissemi nat ion 

These objectives were also accomplished, for the most 
part, on schedule. Some objectives were not accomplished or 
were accomplished late. Publication of the monthly news 
letter was begun later them expected. A progress report to the 
Board of Directors and the Advisory Council was not made. 

A staff meeting on coordination of activities and on com- 
munication with parents was not held. A visit to Greenville 
was scheduled later than originally planned. Board of 
Director's report on communication was not made. 
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Budget and Administrative Considerations 



The administrative staff of the St. John Valley Bilingual 
Program should be commended on the generally excellent man- 
agement of the program, the appropriate use of funds, and on 
the accomplishment status of all program objectives. 
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PART II 



EVALUATION OP SPECIFIC OBJECTIVES 
BY PROJECT COMPONENT 



INSTRUCTIONAL COMPONENT: INTRODUCTION 



This section of the evaluation report first presents the 
results of the standardized tests administered to the program 
students. The results of the students' performance on the 
instructional product objectives, and a description of the 
extent to which the teachers performed the process objectives 
of this component are then reported. The evaluation of each 
product objective is presented and immediately followed by 
the assessment of the corresponding process objective. This 
allows the evaluator to directly relate any problems in the 
performance of the process to the accomplishment or non- 
accomplishment of the corresponding product objective. 

The measurement of each product objective of the Instruc- 
tional Component, was based on the administration of teacher- 
made objective tests, generally administered as pre-tests and 
post-tests. Because of the large number of program objectives 
to be measured, the evaluation design called for the adminis- 
tration of each test to one randomly-selected class at the 
appropriate grade level. In order to determine students' 
skill acquisition, the same class received both the pre-test 
and the post-test for a given objective. At the time of the 
pre-testing the teachers were not informed whether their class 
would get the same post-test; therefore, this theoretically 
prevented each teacher freon emphasing only those objectives on 
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which her class would be measured. Because the class to be 
tested on a particular objective was randomly selected, 
conclusions about the performance of all program classes on 
a particular objective could be based on the performance of 
the single class tested. Discussion of test results, there- 
fore, refers only to the performance of the particular class 
tested, whereas comments about the accomplishment of the 
objective refer to its status for the entire program. 

An assessment of the occurrence of the activities 
specified in the process objectives was begun in December 
and continued until May. Each teacher was provided with a 
process checklist on which she recorded on a daily basis 
those objectives she had taught. The evaluator collected 
the process checklist weekly; at the end of the month he 
tabulated the actual percentage of time spent on each objec- 
tive as compared to the proposed frequency of the activity and 
reported this to the teachers. On-site observation by the 
project evaluator and discussions with classroom teachers con- 
firmed the validity of the process checklist. Continuous 
feedback was provided to the teachers about the appropriateness 
of their classroom activities for accomplishing certain objec- 
tives by the curriculum coordinator, evaluator, and project 
director. 
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The available and .relevant reliability and validity data 
for the standardized tests used in the evaluation of the 
St. John Valley Bilingual Project are included in the 
discussion of the test results, in addition, a determin- 
ation of the reliability and validity of the teacher- 
evaluator constructed test was made. 

Because of the large number of such tests , one for almost 
every instructional objective, the reliability for a random 
sample of 22% of the tests was determined. The Kuder- 
Richardson Formula 21 was used to determine the internal con- 
sistency and, therefore, the reliability of these measures. 

It should be noted that this reliability formula yields a 
consistently low estimate of reliability. The reliability 
for the majority of the tests was greater than .75. 

The validity of these teacher-evaluator constructed 
tests was mainly content or face validity. Because all tests 
were constructed specifically to measure certain objectives, 
they possessed a high degree of content validity. A review of 
the particular tests to determine their congruence with the 
objective they constructed measured confirms the presence of 
high content validity in these tests. The determination of 
validity coefficients for each test is not within the realm 
of this study. 
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INSTRUCTIONAL COMPONENT: 

% 

RESULTS OF STANDARDIZED TESTS 

The standardized testing program proposed in the original 
evaluation design has since been revised. These revisions were 
based on recommendations by various project staff members and 
other professionals who criticized the validity of translating 
some of the tests into a different language. The following 
discussion then, reports only the results of those tests admin- 
istered as part of the revised evaluation design. Some tests 
were administered as both a pre-test in October-November , 1970 
and as a post-test in May, 1971; others were administered only 
in May, 1971. All standardized test results form the baseline 
data for the project. The standardized test results sire reported 
according to the specific skill area they measure. 

Readiness Skills 

The Metropolitan Readiness Test, Form A was administered to 
all kindergarten students in the project in May, 1971. Based on 
their performance on this test, a rating of their readiness for 
first grade work was obtained. Table 17 indicates the per- 
centage of students in each district and in the entire program 
who received each of the five, possible ratings on this test. 



Table 17 



Metropolitan Readiness Test — 
Rating for Total Score 





School District 


N 


% Rating 







Superior 


High 


Average 


Low 


Low 








Normal 




Normal 




Frenchville 


37 


5 


38 


40 


14 


0 


Madawaska 


47 


60 


24 


17 


0 


0 


Van Buren 


32 


16 


32 


25 


28 


0 


Entire Program 


116 


29 


32 


27 


12 


0 



According to the interpretative norms included in the 
manual for the Metropolitan Readiness Test , all students 
receiving a rating of Average, High Normal, or Superior are 
likely to succeed in first grade work, although they might 
experience varying degrees of success. The norms indicate 
that those students receiving a rating of Low Normal or Low 
are likely to have difficulty in first grade work. The results 
shown in Table 17 suggest that the large majority of students 
are likely to succeed in first grade work; only 12% of the 
students in the entire program received a score which signifies 
a likelihood of having difficulty in first grade work. No 
student received a rating of Low which would suggest that he 
required further readiness work. The high percentage of 
students who received Superior or High Normal scores is highly 



commendable; the program seems to be preparing these students 
quite well for first grade work. 

Oral Ability in French 

The ability of program students to understand spoken 
French was assessed by the Common Concepts Foreign Language 
Test - French Version . This 80-item test required the students 
to listen to a stimulus sentence read by the tester and then 
circle one of four pictures which the sentence represented. 
Kindergarten students completed one-half of the 80 items , for 
a total possible score of 40 , and the grade one students 
completed the entire test for a possible score of 80. Both 
groups completed form 1 as a pre-test and form 2 as a post-test. 
Only a random sample of program students were tested; because 
students were randomly selected , however, the findings on this 
test can be generalized to a description of the skill acquisition 
of the entire program group. A t-test for correlated data was 
used to compare the pre-test and post-test scores for selected 
groups of children. Tables 18 - 20 summarize the results on 
this test for the kindergarten students. 



J; 






f 



I 

ERIC 



. 58 



62 



Table 18 



Common Concepts Foreign Language Test-French 
Version: Entire Kindergarten Group 

N, X, SD, % dt Criterion and t-ratio 



N=44 




Pre 


Post 


X 


22.3181 


22.3863 


SD 


6.1304 


8.1832 




Difference 






Between Means 


0.0682 




df 


43 




t 


0.0662* 



* Not Significant 



Table 18 indicates that no significant difference existed 
between the pre-test scores and the post-test scores for the 
kindergarten students tested. Because this group included both 
French and English students, a determination of significant 
gain for either group was in order. Tables 19 and 20 summarize 
the t-test for correlated data for each of these two groups. 

The results summarized in Tables 19 and 20 show that no 
significant difference existed between the pre-test and post- 
test scores for either English or French kindergarten students. 
Discussions with the classroom teachers about possible reasons 
for this seeming lack of impact of program participation on 
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Table 19 



Common Concepts Foreign Language Test-French 
Version French- Dominant Kindergarten Students 
N, X, SD, % at Criterion and t-ratio 



N«29 





Pre 


Post 


X 


24.2413 


24.7241 


SD 


5.6974 


7.7009 



Difference 

Between Means 0.4828 

df 28 

t 0.3371* 



* Not significant 
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Table 20 

Common Concepts Foreign Language Test-French Version : 
English- Dominant Kindergarten Students 
N, X, SD, % at Criterion and t-ratio 



N=i5 





Pre 


Post 


X 


19.2000 


18.5333 


SD 


6.8137 


8.3176 



Difference 
Between Means 
df 
t 



0.6*367 

14 

0.5198* 



* Not Significant 
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performance suggested the following explanations: the test 

was too difficult for the students; not enough French was 

% 

introduced into the classroom; the two forms of the test were 
not comparable for these students . The evaluators recommend 
that the program staff investigate these issues and implement 
appropriate changes before 1971-72 program year. 

The grade one students completed the entire test; a 
similar analysis was performed on their test results. Tables 
21 - 23 display the results for this grade level. 

Table 21 

Common Concepts Foreign Language Test-French 
Version: All Grade One Classes 

N, 5f, SD, % at Criterion and t-ratio 



N=52 




Pre 


Post 


X 


48.3846 


55.3269 


SD 


13.0607 


12.0012 




Difference 
Between Means 


6.9423 




df 


51 




t 


7.0832* 



* <.001 
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Table 23 



Common Concepts Foreign Language Test-French 
Version^ English-Dominant Grade one Students 
N, X , SD, % at Criterion and t-ratio 



N=21 






Pre Post 


X 




42.2857 48.7142 


SD 




15.9646 13.8295 




Difference 


• 




Between Means 


6.4285 




df 


20 




t 


3.7000* 



* < .01 

A review of Tables 22 and 23 indicate that both the 
French-dominant students and the English-dominant students 
scored significantly differently on pre-test and post-test 
measure of their oral ability in French; the post-test mean 
score was higher than the pre-test mean score . Participation 
in the bilingual program seems to have had a positive effect 
on the grade one students' oral ability in French. The gains 
experienced by the grade one students as opposed to the lack of 
gains shown by the kindergarten pupils suggest that perhaps a 
greater maturity is required for demonstration of gains in oral 
French ability, or the addition of more French instruction into 
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the curriculum in grade one is responsible for the significant 
difference between pre-test and post-test scores for that group. 

* 

Fluency In English 

A random sample of English-dominant students completed 
the Michigan Oral Language Productive Test to measure their 
fluency in their native language. Originally an administration 
of a French translation of this test had been planned for the 
French-dominant students, but the problems of translation added 
too much invalidity to the measure. The Michigan Oral Lan- 
guage Productive Test involved the students ' to a series 
of 43 items. In each question the tester presented the student 
with a verbal and pictorial stimulus; the student was required 
to complete the incomplete verbal stimulus sentence or sentences 
stated by the tester. The Michigan Oral Language Productive Test 
yields in addition to the total score, a series of subscale scores 
which describe the student's performance in particular grammatical 
and structural categories. The evaluator provided each teacher 
with a diagnosis of her students' weaknesses for the pre-test 
and the post-test; these reports are included in the project 
files. Tables 24 and 25 summarize the analysis of the results 
on the Michigan Oral Language Productive Test for the kinder- 
garten and Grade one students; a t-test for correlated data 
was used to compare the prer*tes.t and post-test scores. 



Table 24 



Michigan Oral Language Productive Test: 
_ Kindergarten Students 
N, X, SD, % at Criterion and t-ratio 



N=ll 





Pre 


Post 


X 


28.000 


34.4545 


SD 


8.0226 


4.8499 



Difference 
Between Means 
df 
t 



6.4545 

10 

4.5158* 



* < .01 



Table 25 

Michigan Oral Language Productive Test: 
_ Grade One Students 
H, X, SD, % at Criterion and t-ratio 



N=16 





Pre 


Post 


X 


32.6875 


36.1875 


SD 


6.8439 


7.1608 



Difference 




Between Means 


3.5000 


df 


15 


t 


3.3624* 
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* < .01 
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A reference to Tables 24 and 25 indicates that both the 
kindergarten and grade one English-dominant students scored 
significantly differently on the pre-test measure of their 
fluency in English. In both cases the post-test mean score 
was higher than the pre-test mean score. These results suggest 
that participation in the program probably had a significant 
influence on the students’ fluency in English. A review of the 
diagnostic analyses reveals no uniform difficulties with 
particular structural patterns for all English-dominant 
students. 

Perceptual -Motor-Language Skills 

As a part of the regular testing program in the individual 
school districts of the program, all kindergarten and first 
grade students completed the Meeting Street School Screening 
Test in May, 1971. This test yields a total score and three 
subtest scores. Motor Patterning, Visual-Perceptual-Motor, and 
Language . The interpretative norms classify the subtest scores 
and the total score into three categories — Low, Average, or 
Above Average. Tables 26 and 27 display the percentage of 
students whose scores fall into each of these categories for 
the total score and three subtest scores. Because all students 
were tested with this measure the record of scores serves as 
baseline data on each student's perceptual, motor, and language 
skills. 







Table 26 

Meeting Street. School Screening Test 
All Kindergarten Students (N=lll) 



Subtest 


% of 


Ratings 






Above 

Average 


Average 


Low 


Motor Patterning 


31.5 


61.3 


7.2 


Visual-Perceptual-Motor 


36.0 


63.1 


0.9 


Language 


7.2 


70.3 . 


22.5 


Total Score 


23.4 


66.7 


9.9 



Table 27 






Meeting Street School Screening Test: 




All Grade One Students 


(N=138) 




Subtest . % 


of Rating 




Above 






Average 


Average 


Low 


Motor Patterning 21.7 


72.5 


5.8 


Visual-Perceptual-Motor 8 . 7 


73.9 


17.4 


Language 3.6 


63.0 


33.3 


Total Score 4.3 


84.8 


10.9 
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The results shown in Tables 26 and 27 indicate that the 
majority of kindergarten and first grade students received a 
score of Average or Above Average on each of the three subtests 
and on the total score of the Meeting Street School Screening Test . 
However, both the kindergarten and grade one groups had a large 
percentage of students who received a score of Low on the Language 
subtest which includes such tasks as repeating words, repeating 
sentences, counting, telling a story, and language sequencing. 

The evaluators recommend that the project staff review the par- 
ticular tasks involved in this subtest and consider integrating 
some of these activities into the kindergarten and first grade 
curriculum . 

Reading in English 

In order to measure the grade one program students' abil- 
ity to read in English, the 1970 edition of the Metropolitan 
Achievement Tests - Primary I Level was administered to the 
students during May, 1971. The scores for each student des- 
cribe in one way his ability to read in English. Because stu- 
dents were tested in May# 1971 a student who was performing 
at grade level would receive a grade equivalent score of 1.9. 

Table 28 summarized the student's performance on the reading 
subtests of the Metropolitan Achievement Test . It indicates 
the percentage of students who received a score above grade 
level, at grade level, and below grade level. 



Table 28 



Metropolitan Achievement Test — Pr imar y i Level 
Reading Scores - Grade One (N=139) 



Subtest % - Relation to Grade Level 



Above 



At Below 



Word Knowledge 
Word Analyis 
Reading 
Total Reading 



32.4 11.5 56.11 

26.6 10,1 63.3 

25.9 10.8 63.3 

37.4 9.4 53.2 



These results suggest that a larger percentage of students 
were below grade level in reading than above grade level or at 
grade level; the students seem to perform equally poorly on the 
on the three subtests . The evaluators recommend that a review 
of the content of these tests be made to determine if they 
are appropriate for the curriculum included in grade one in 
the St. John Valley. If the test is valid for the curriculum, 
a more intense focusing upon the concepts presented in the test 
should be made in the first grade instruction. 

Mathematics Skills 

The Metropolitan Achievement Test , 1970 edition. Primary I 
Level was administered to the grade one students to obtain a 
measure of their mathematics skills. One subtest assessed the 
students abilities to solve simple word problems and non-word. 



computation problems. A total mathematics score was obtained 
to describe their performance. Students who performed at grade 
level should have received a grade equivalent score of 1.9 
because they were tested in May, 1971. Table 28A displays 
the percentage of students who scored above, at, and below 
grade leval on this measure. 

Table 28A 

Metropolitan Achievement Test-Primary I Level- 
Total Mathematics Score Grade One (N= 138) 



% 


- Relation to Grade 


Level 


Above 


At 


Below 


48.6 


2.9 


50.4 



The results summarized in Table 28A indicate that the 
majority of students also scored below grade level on this 
measure of their mathematics skills. The evaluators recommend 
that a review of the content of the test be made by the program 
teachers. If it is valid for the first grade curriculum, appro 
priate changes in the grade one mathematics curriculum should 
be im plemented to improve the students' performance on mea- 
sures of mathematics skills. 
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INSTRUCTIONAL COMPONENT 



KINDERGARTEN OBJECTIVES 
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Objective K-l . 1 : 

At the conclusion of the year 90% of the children 
will provide correct verbal answers 80% of the 
time, when provided appropriate exercises for the 
following visual perception skills: Use of picture 

clues, recognition of basic shapes, descriminate 
likeness and differences in words and letters, 
demonstrate left-right arm movement. Their abili- 
ties will be measured by teacher ratings and obser- 
ver checklists . 

Evaluation : 

Students were measured in each of the visual perception 
skill areas cited in objective K-l.l as a pre-test and as a 
post-test. A t-test for correlated data was performed between 
the pre-test and post-test scores for each test. The analyses 
. are summarized in Tables 29-33. 

In order to measure their skill in the use of picture 
clues, the students were presented a large picture of a boy 
looking at an airplane and three small pictures of an airplane, 
a car, and a boat. The tester asked the child to identify which 
of the three small, pictures the boy could see ; this procedure 
was repeated for each of the three small pictures allowing 
a possible score of three correct. Table 29 shows that on 
the pre-test 84% of the students achieved the criterion level 
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Table 29 



Instructional Objective K-l.l: 

_ Use of .Picture Clues 
N, X, SD, % at Criterion and t-ratio 





N=23 


.. ■ 




Pre 


Post 


X 
SD 
% at 


Criterion 


2.8000 

0.6324 

84 


3.0000 

0.0000 

100 




Difference 
Between Means 
df 
t 


0 . 

0 


2000 

22 

.3162* 



* Not Significant 

of thr ee correct answers. On the post-test, however, 100% 
of the students achieved the criterion level of three cor- 
rect answers; therefore this part of the objective was 
accomplished by the end of the program. Because of the high 
mean score on both the pre-test and the post-test Table 29 
indicates that no significant difference existed between the 
two sets of scores. It. should be noted that in order to 
obtain a significant difference it might be necessary to include 
more items on the test, or to include items which discriminate 
more successfully between various ability levels of students. 



Table 30 
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Instructional Objective K-l.l: 

_ Recognition of Basic Colors 
N, X, SD, % at Criterion and t-ratio 





N=25 




Pre 


Post 


X 
SD 
% at 


7.2800 

1.7554 

Criterion 84 


7.6800 

1.2237 

92 




Difference 
Between Means 
df 
t 


0.4000 

24 

0.9701* 



* Not Significant 



The recognition of basic colors at the kindergarten 
level was measured by the teacher's presenting basic color 
cards to the child and requesting him to identify each color. 
Eight color cards were presented; therefore, the highest 
possible score for this measure was eight. Table 30 shows 
that on the pre-test 84% of the students received a score of 
7 or better required by the criterion level stated in the 
objective. On the post-test, however, 92% of the students 
achieved the criterion level; therefore, the objective was 
satisfied on the post-test. Reference to Table 30 also indi- 
cates that because of the high mean pre-test and post-test 
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scores, no significant difference exists between the two 
sets of scores. 



Table 31 

Instructional Objective K-l.l: 
_Recognition of Basic Shapes 
N, X, SD, % at Criterion and t-ratio 



N» 24 





Pre 


Post 


X 


2.6666 


33.9583 


SD 


1.2472 


0.2000 


% at Criterion 


36 


96 



Difference 

Between Means 1.2917 

df 23 

t 5.2916* 
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* <.001 

The teachers tested this section of the first kindergarten 
objective by presenting the child with a series of four basic 
shapes and asking the child to identify these shapes. The 
highest possible score in this test was four; the score 
required by the objective percentage of 80% correct was also 
four. The results in Table 31 indicate that on the pre-test 
only 46% of the students, far below the criterion level, could 
identify the four shapes correctly, while on the post-test 96%, 
or greater than the 90% required by the objective, could identify 
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the shape correctly. As might be expected from these per- 
centages, Table 31 also indicates that a significant differ- 
ence in scores occurred between the pre-test and post-test 
results for the group tested. A difference so large could 
have occurred by chance less than one time in 1,000. In the 
area of recognition of basic shapes, then, the kindergarten 
students made significant gains during the program year. 

Table 32 

Instructional Objective K-l.ls Discrimination of 
Likenesses^ and Differences in Words and Letters 
N f X, SD, % at Criterion and t-ratio 





N= 24 






Pre 


Post 


X 

SD 

% at 


Criterion 


2.4583 

1.4994 

40 


3.5416 

0.8155 

95 




Difference 
Between Means 
df 
t 


1.0833 

23 

3.2907* 





* <.01 



The teacher-made tests constructed to measure the stu- 
dents' ability to discriminate likenessess and differences in 
words and letters involved the students' selecting from a group 
of letters or words on the right the match for the stimulus 
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letter or word on the left. The highest possible score on this 
test was four; in order to satisfy the criterion of 80% correct, 
a score of four correct was required to accomplish the objective. 

Table 32 indicates that only 40% of the students could perform 
this task on the pre-test , and 95% of the students, more than 
required by the criterion specified in the objective, could 
perform this activity on the post-test. Similarly, reference 
to Table 32 indicates that a significant difference between 
the pre-test and post-test scores existed on this test. It 
seems possible to conclude , therefore , that participation in the 
bilingual program had a significant effect on the students' 
abilities to descriminate likenesses and differences in words 
and letters. 

Table 33 ! 

Instructional Objective K-l.l: 

Demonstrate Left - Right Eye Movement 
N, X, SD, % at Criterion and t-ratio 



N= 24 



i,' • 


• 


Pre 


Post 


h 


X 


1.4583 


2.0000 


{y 


SD 


0.8650 


0.0000 




% at Criterion 


72 


93 


w 









$ 



iW 

kil 
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w 



Difference ‘ 

Between Means 0.5417 

df 23 

t 0.6262* 



* Not Significant 
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The ability to demonstrate left-right eye movement was 
shown by 72% of the students on the pre-test and 93% on the post- 
test, a percentage greater than the criterion percentage. The 
activity used to assess left - right eye movement involved the 
child's drawing lines from left to right on a sheet with two 
pictures on it, beginning at a place marked "X" on the sheet. 
Although no statistically significant difference between pre-test 
and post-test results existed, the criterion of the objective 
was satisfied on the post- test but not on the pre-test. 

Objective K-l.l seems to have been accomplished during the 
kindergarten year of the bilingual program. No part of the 
objective was accomplished by the required percentage on the 
pre-test; all five parts of this objective had been performed 
by the appropriate percentage of students on the post-test. 

These results suggest that participation in the program had a 
positive influence on the achievement of this objective. 

Objective K-l . IP : 

The classroom teacher will evaluate each child indi- 
vidually at the beginning of the year and group child- 
ren for instruction. Teachers will provide appropriate 
exercises and opportunities to perform at least once 
a week. These activities will be recorded in the les- 
son plan book. 

Evaluation : 

Interviews with teachers indicated that they evaluated 
each child individually on those skills cited in objective 
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K-l.l at the beginning of the year, either formally with a 
structured classroom exercise or informally during instructional 
activities. Opportunities to perform exercises related to 
this objective were provided at least once a week by the follow- 
ing percentage of teachers: 

December - 100% 

January - 100% 

February - 100% 

March - 100% 

April - 100% 

May - 88% 

These frequencies indicate that for five of the six months 
during which the process was recorded, K-1.1P occurred in all 
classrooms at the anticipated frequency, at least once a week. 
During the month of May it occurred 88% of the required time; 
this decrease in frequency was due to the use of many classroom 
hours for testing during May. Similarly, the appropriateness 
of the processes used to / accomplish the product objective seems 
evident because the product objective was accomplished. 



Objective K-l . 2 : 



At the end of the year, 50% of the children will 
respond correctly 50% fo the time to the following 
auditory perception skills: Can reproduce pronounced 

two or three syllable words; can hear differences in 
words; able to distinguish differences in the length 
of two pronounced words ; able to hear sound at the 
beginning, end, and middle of words; able to verbally 
extract two rhyming words from a list of four words, 
two of which rhyme; knows number of sounds in spoken 
words. These will be measured by teacher ratings 
and observer checklist. 



Evaluation : 



Each of the four skills included in objective K-1.2 
was measured by a separate objective test ("Knows number of 
sounds in spoken word" was deleted from the objective during 
the program) . A t-test for correlated data was done on each 
of the four sets of scores. The results of these analyses are 
summarized in Tables 34-37. 

Table 34 

Instructional Objective K-1.2: Can Reproduce 

Pronounced Two or Three Syllable Words 
N, X, SD, % at Criterion and f-ratio 



N= 21 



Pre Post 



X 

SD 

% at Criterion 



5.7619 5.7142 

G.4259 0.9333 

100 90 



1 



i 

Difference 




Between Means 


0.0477 


df 


20 


t 


0.2376* 



* Not Significant 



In order to measure the ability of students to reproduce 
pronounced two or three syllable words, each student was 
presented with one card with pictures of two syllable words 
on it, such as wagon, and a second card with pictures of three 



syllable words on it , such as bicycle. The teacher showed 
the student a picture, pronounced the word, and asked the child 
to repeat the word. The highest possible score on this test 
was six correct. The results in Table 34 state that 100% 
of the students achieved the criterion level on the pre-test, 
and 90% of the students achieved the criterion level on the 
post-test; both were sufficient to accomplish this objective. 
Because a satisfactory number of students could perform the 
task on the pre-test , it is possible that this part of the 
objective may not be appropriate for kindergarten students; 
the fact the no significant difference existed between the 
pre-test and post-test scores further suggests the lack of 
program impact on this skill. 

In order to measure the students' ability to hear differences 
in words, the teacher talked informally with the child about 
a series of three picture pairs represented on cards; each 
pair represented two words which sounded different. The teacher 
attempted to have the child understand the difference in meaning 
between two stories because they represented two differently- 
pronounced words. The highest possible score was six correct; 

On both the pre- and post-test 100% of the students received 
at least the score of three required by the 50% correct criterion 
stated in the objective. Table 35 also* indicates that no 
significant difference existed between the pre-test scores and 
post-test scores. This suggests that either the objective was 



Table 35 



Instructional Objective K-1.2: Can 

__ Hear Differences in Words 
N, X, SD, % at Criterion and t-ratio 



N= 21 






Pre 


Post 


X 




4.9523 


6.0000 


SD 




0.7855 


0.0000 


% at 


Criterion 


100 


100 




Difference 








Between Means 


1 


.0477 




df 




20 




t 


0 


.2910* 



* Not Significant 

not appropriate for the kindergarten children or the processes 
used to accomplish it were inappropriate or too infrequent. 

Table 36 shows the results of the measurement of this part 
of Objective K-1.2. Students were presented with a word card 
on which were printed three pairs of words . The teacher pronoun 
ced one pair of words and asked the pupil to identify the word 
which sounded longer. Similar procedure was followed for the 
other two pairs of words; the highest possible tscore in this 
activity was three. Students were required to answer two of the 
three items correctly to satisfy the criterion of responding 
accurately 50% of the time specified in the objective. Table 36 



Table 36 



Instructional Objective K-1.2: 
Able to Distinguish Differences in 
the Length of Two Pronounced Words 
N, X, SD, % at Criterion and t-ratio 



N= 18 





Pre 


Post 


X 


2.0555 


3.0000 


SD 


1.0787 


0.0000 


% at Criterion 


76 


100 



Difference 

Between Means 0.9445 

df 17 

t 0.8755* 



* Not Significant 

indicates that 76% of the students received at least a 
score of two on the pre-test, and 100% of the students received 
an appropriate score on the post-test. On both pre- and post- 
test, therefore, the criterion percentage of 50% of the class 
responding correctly was obtained. No significant difference 
existed between the pre-test and post-test scores. Again, this 
suggests the possibility that the objective or its criterion 
level was inappropriate for these students because it had been 
achieved before they entered kindergarten. 

The results in Table 37 indicate that a significant dif- 
ference existed between the pre and post ability of students to 
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Table 37 

Instructional Objective K-1.2: Able to 

Hear Sound at the Beginning, End, 

_ and Middle o£ Words 

N, X, SD, % at Criterion and t-ratio 



N= 21 






Pre Post 


X 




♦ 

1.7619 3.0000 


SD 




1.4769 1.3092 


% at 


Criterion 


29 .52 




Difference 






Between Means 


1.2381 




df 


20 




t 


4.3641* 



* <.001 



hear sounds at the beginning, end, and middle of a word. On 
the pre-test 29% of the students accomplished the objective, 
and on the post-test 52% of the students, a larger percentage 
than required by the objective performed the required task 
satisfactorily . The ability to hear sounds in a word was 
tested by presenting the students with a group of objects; 
the teacher then named four objects and asked the student to 
name the two objects whose names sounded the same or rhymed. 
The highest possible score on this activity was eight correct. 
Table 37 indicates that the students' mean scores on the pre- 
test and on the post-test were quite low. Students showed 
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significant gains on this skill during the program year; this 
objective seems to be an appropriate one for kindergarten child- 
ren, and the criterion level of 50% established for accomplish- 
ment of this skill also seems to be a reasonable goal for which 
to strive . 

Objective K-1.2 was accomplished ; yet in only one of the 
four skill areas measured did the students demonstrate sig- 
nificant gains between the pre- and post-test. Also, in only 
one skill area the students were not at the criterion level 
specified in the objective on the pre-test. The evaluators 
recommend that a review of the appropriateness of this objec- 
tive and especially of the criterion level specified in the 
objective be made. 

Objective K-l.P < 

The classroom teacher will evaluate each child 
individually at the beginning of the year and 
group children for instruction. Teachers will 
provide appropriate exercises and opportunities 
to perform at least once a week. These activi- 
ties will be recorded in the lesson plan book. 

Evaluation : 

Each child was evaluated individually at the beginning of 
the year by his classroom teacher. Students were then grouped for 

i 

instruction, and appropriate exercises were provide for prac- 
ticing the skills specified in the objective. The frequency 



88 



84 



of these activities compared to the required frequency 
follows : 

December - 83% 

January - 93% 

February - 100% 

March - 90% 

April - 100% 

May - 81% 

Generally, the teachers in the program were performing this 
process objective 80% as frequently as stated in the proposal. 
The actual process activities used seem somewhat appropriate for 
accomplishing objective k- 1.2 because some gains -in the percent- 
age of students who could perform the objective occurred; the 
exact appropriateness of the process cannot be determined be- 
cause of the high percentage of participants who had satisfied 
the objective on the pre-test. 



Objective K-l . 3 : 



At the end of the year 50% of the children will 
respond correctly 50% of the time to the following 
word recognition exercises : recognizes his own 

name in print, knows names of letters, knows 
names of numbers 1 to 10, can match oral name of 
letter to written symbol, can match oral name of 
number to written symbol, can match capital and 
small letters. 



Evaluation: 



The analyses of scores obtained from the measurement of this 
objective are summarized in Tables 38-43; unless otherwise 
indicated, a t-test for correlated data was used to compare 
the pre-test and post-test scores for each test. 



Table 38 



Instructional Objective K-1.3: 
Recognizes Own Name in Print 
Summary of Sign Test for Correlated 
Data and Percent at Criterion Level 



Number with Pre and Post Scores 17 

Number Showing Positive Change 3 

Number Showing Negative Change 0 

z 1.1547 

p not significant 



% at Criterion-Pre 82 

% at Criterion-Post 100 



The ability of students to recognize their own name in 
print was tested by the teacher's presenting the student with 
five first names of students in the class and asking the stu- 
dent to select his own first name. The response of the child 
was scored as either "yes" or "no" he could or could not do 
the objective. Table 38 indicates that on the pre-test 82% 
of the students, a percentage greater than the 50% criterion 
level, could perform the task, and on the post-test 100% of 
the students could perform the task sufficiently. A sign test 
for correlated data, as summarized in Table 38, showed that 
no significant difference existed between the pre-test and post' 
test scores . The high percentage of students who could perform 

t 

this task on the pre-test suggests that the appropriateness of 



Table 39 



Instructional Objective K-1.3: 

_ Knows Names of Letters 
N, X, SD, % at Criterion and t-ratio 





N= 17 




Pre 


Post 


X 

SD 
% at 


4.7058 

6.2192 

Criterion 24 


13.4117 

7.8819 

71 




Difference 
Between Means 
df 

t 5 


8.7059 

16 

.5653* 



* <.001 



In order to measure the students ' ability to know the 
names of letters, each child was asked to identify a series 
of consonant letters presented to him one at a time. The 
highest > possible score on this test was 21. Table 39 indicates 
that on the pre-test 24% of the students could perform this task 
successfully, and on the post-test 71% of the students could 
accomplish this task successfully. A highly significant dif- 
ference existed between the pre-test and post-test scores, a 
difference that could have occured by chance less them one time 
in 1,000. The students did not satisfy the criterion level 
specified in the objective on the pre-test, although on the post- 
test the 71% of students who could perform the objective was 
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greater than the 50% required by the objective. Program parti- 
cipation seems to have had a positive impact on acquisition of 
this skill. 



* <.01 

The naming of numbers from 1 to 10 was tested by present- 
t ing each child with a mixed series of numbers one at a time and 
asking the child to name the number presented. The highest 
( possible score a child could receive was ten. Table 40 reports 
that 59% of the students received a score of five correct out 
of ten required by the objective on the pre-test, and on the 
post-test 82% of the students received an appropriate score. 

On both pre- and post-tests, then, the criterion level of 50% 



Table 40 



Instructional Objective K-1.3: 

_ Knows Names of numbers 
N, X, SD, % at Criterion and t-ratio 



N= 17 



Pre 



Post 



X 

SD 

% at Criterion 



5.5882 

3.6146 

59 



8.5294 

3.2560 

82 



Difference 
Between Means 



2.9412 

16 

3.1646* 



df 

t 
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of the class specified in the objective was accomplished. It 
is important to note, however, as shown in Table 40, that a 
significant difference at the .01 level existed between the 
pre-test scores and the post-test scores. This observation 
suggests that the criterion level specified in the objective 
was not appropriate for the students and should have been 
higher, since some growth in their ability to recognize the 
numbers 1-10 seems to have occurred, although no change was 
made in the accomplished status of the objective between the 
two testings. 

Table 41 

Instructional Objective K-1.3: Can Match 

Oral_Name of Letter to Written Symbol 
N, X, SD, % at Criterion and t-ratio 







N= 16 







Pre 


Post 


X 


2.6250 


4.1250 


SD 


2.2878 


2.3683 


% at Criterion 


35 


76 





Difference 






Between Means 


1.5000 




df 


15 




t 


\ ,2.5354* 
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The teacher measured the ability of the students to match 
the oral name of a letter to its written symbol by placing a 
card in front of the student with written letters on it and 
asking the student to point to the letter named by the teacher. 

The student was directed to locate six different letters yielding 
a possible score of six; 1% correct or a score of three was 
required to satisfy the objective. Table 41 says that 35% of 
the students satisfied the objective on the pre-test , and 76% 
of the students satisfied the objective on the post-test. In 
addition, a significant difference between the pre-test and 
post-test scores occurred. Because of the existence of a sig- 
nificant difference and because the objective was accomplished 
on the post-test but not on the pre-test, the appropriateness 
of this part of the objective as stated for the kindergarten 
children and the impact of the program participation on its 
accomplishment are evident. 

The ability of the students to match the oral name of a 
number to its written symbol was tested by placing in front of 
each student a series of cards with written numbers on them and 
asking the student to locate the number specified by the teacher. 
Since the students were required to do this task for each number 
from 1 through 10 presented in mixed sequence, in order to satisfy 
the objective a student was required to answer five of the ten 
items correctly. Table 42 indicates that the criterion level 
of 50% of the class receiving a score of at least five was 
satisfied on the pre-test with 76% receiving such a score and 



Table 42 



Instructional Objective K-1.3: Can Match 

Oral Name of Number to Written Symbol 
N, X, 5D, % at Criterion and t-ratio 



N= 17 





Pre 


Post 


X 


6.4117 


8.8822 


SD 


2.8297 


2.7841 


% at Criterion 


• 76 


88 



Difference 
Between Means 
df 
t 



2.4706 

16 

3.3814* 



* <.01 

on the post-test with 88% of the students receiving such a score. 
The results summarized in Table 42 also suggest that this cri- 
terion level might not be appropriate. Because a significant 

. > 

difference existed between the pre- and post-test scores it 
seems that the program affects acquisition of this skill, that 
they did gain a greater ability to match the oral name of a 
number to the written symbol during the program. It seems 
possible, then, that the criterion level of 50% is not suffi- 
ciently high because it had been reached on the pre-test. 

The ability of students to match capital and small letters 
was measured by the student's pointing to a capital letter in 



Table 43 

Instructional Objective K-1.3: Can 

Match Capital and Small Letters 
N, X, SD, % at Criterion and t-r a tio 



N= 16 






Pre Post 


X 




6.1250 11.0625 


SD 




3.3888 4.8287 


% at 


Criterion 


35 76 




Difference 






Between Means 


4.9375 




df 


15 




t 


3.4661* 



* <.01 

the left column and then to the corresponding small letter in 
the right column. Since fifteen pairs of letters were presented 
the highest possible score in this test was 15; a score of eight 
was required to accomplish the objective. Table 43 indicates 
that 35% of the students could do the task at the appropriate 
level on the pre-test , and 76% could perform the appropriate 
task on the post-test. The post-test scores satisfied the 
criterion stated in the objective, whereas the pre-test scores 
were too low to satisfy it. Similarly, a significant difference 
existed between the pre-test and post-test scores, a difference 
which could have occurred by chance less than one time in 100. 



This aspect of objective K-1.3 seems to be an appropriate goal 
for the students in the kindergarten classes. 

One-half of the tasks cited in objective K-1.3 seem to 
be appropriate as objectives for the students in the kinder- 
garten class. The remaining tasks were, for the most part, 
accomplished at the time of the pre-testing. A consideration 
of raising the percentage of the class required to perform the 
objective should be made or parts of objective should be com- 
pletely eliminated from the program, because the students 
have accomplished them before they entered the program. 

Objective K-1.3P ; 

The classroom teacher will evaluate each child 
individually at the beginning of the year and 
group children for instruction. Teachers will 
provide appropriate exercises and opportunities 
to perform at least once a week. These activi- 
ties will be recorded in the lesson plan book. 

Evaluation : 



At the beginning of the school year children were evaluated 

individually and grouped for instruction. Teachers provided 

appropriate exercises for the accomplishment of objective K-1.3 

with the following percentage of the required frequency: 

December - 50% 

January - 53% 

February - 84% 

March - 80% 

April •* 92% 

May - 87% 



It seems evident from these percentages that the performance 
of this activity occurred more frequently as the school year 
progressed. Although the teachers did not perform the activity 
at least once a week 100% of the time, the number of times they 
performed the activity seemed to be appropriate because objective 
was accomplished. A review of the proposed frequency of 
the process activity should be made and appropriate revisions 
implemented . 

Objective K-1,4 ; 



At the end of the year 50% of the students will 
pronounce correctly all 220 Dclch basic words. 
This will be measured by teacher ratings and 
observer checklists. 



Evaluation : 



The students were required to repeat a sample of the ten 
words or phrases selected by the teachers from the Dolch basic 
words. The students received a score of "yes" they could. 



pronounce all ten words correctly, or "no" they could not. A 



sign test for correlated data was performed to compare the pre- 
test scores; the results of this analysis are summarized in 
Table 44. 



As shown in Table 44 the class tested accomplished the 
objective of pronouncing correctly the sample of Dolch basic 
words. Eighty-two percent could pronounce these words correctly 
on the pre-test, and 100% of the class could do the task on the 



Table 44 



Instructional Objective K-1.4 
Summary of Sign Test for Correlated 
Data and Percent at Criterion Level 



Number with Pre and Post Scores 
Number Showing Positive Change 
Number Showing Negative Change 



z 




not significant 



17 

3 

0 

1.1547 



P 



% at Criterion-Pre 
% at Criterion-Post 



82 

100 



post-test. No significant difference existed between the pre 



test and post-test scores , as shown in Table 44. A review of 
the testing for this particular objective suggests that per- 



review of the testing of this objective for the following 
year be done* as well as a consideration of increasing the 
criterion level of the objective be made. Objective K-1.4 
was accomplished on both the pre- and post-tests . 



Objective K-l . 4P : 



The project director will provide classroom 
teachers with cards for the language master. 
Children will be provided individualized 
diagnosis by the teacher , and individualized 
drill time on the words they do not know at 
least once a week. The activities will be 
recorded in the lesson plan book. 



haps a more difficult test should have been constructed which 

sampled more of the Dolch sounds. The evaluators recommend a 
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Evaluation: 



The project director provided classroom teachers with cards 



the usage of these cards 



for the language master. Frequency of 
can be determined by referring to the evaluation of equipment 
usage later in this report. Children were provided with indi- 
vidualized diagnosis by the teacher and individualized drill 
time on the words they did not know at least once a week for 
the following percentage of required time : 



December - 100% 
January - 93% 
February - 76% 
March - 85% 
April - 92% 
May - 82% 



During each of the six months for which process was 
recorded at least 75% of the time required for this process 
activity was devoted to it. This performance of process seems 
sufficient to maintain the skills specified in product objective 
K-1.4 . 



Objective K-1.5 : 



At the end of the year 50% of the students will 
pronounce correctly all 115 words usually found 
in pre-primers, given the word orally to be 
repeated to the teacher. This was measured by 
teacher ratings and observer checklists. 
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Evaluations 

Table 45 summarizes the results of the test of words 
found in pre-primers; a t-test for correlated data was used to 
compare the pre-test and post-test scores on this measure. 



Table 45 

^Instructional Objective K-l . 5 
N, X, SD, % at Criterion and t-ratio 

i . - ■ ' •' 





N= 25 






Pre ( ! Post 


X 

SD 
% at 


.. . 

Criterion 


6.0000 6.0000 

0.0000 0.0000 

100 100 




Difference 
Between Means 
df 


0.6000 

24 

0.0000* 



* Not Significant 



The child was tested by being shown a picture and hearing 
the teacher pronounce the word it represented; the child was 
requested to repeat idle word. A response was considered correct 
if it was an exact repetition of the word pronounced by the 
teacher. The children were presented with six cards; therefore, 
the highest possible score was six. On both pre- and post^tests 
all children tested answered all questions correctly; therefore, 
no significant difference existed between the pre-test and post- 




98 



Tmm, 



-T, 






test scores. The students' performance on this test suggested 
that the objective or the testing procedure was inappropriate, as 
100% of the students could do the objective on both pre- and* 
post-tests . The evaluator recommends that a review of objective 
K-l . 5 occur , with emphasis on a determination of the appropriate- 
ness of the objective, and the testing procedures, objective 
K-l. 5 was accomplished. 



Objective 



K-l . 5P : 



The oral approach will be used, supplemented for 
individual students with individualized drill on 
the language master . The project director will 
provide classroom teachers with language master 
cards with this array of words. The drills will 
be used at least once a week and recorded in the 
lesson plan book. 



Evaluation: 



ERIC 



A monitoring of individual classrooms indicated that the 
oral approach was used to maintain objective K-l. 5, and that 
the teachers were provided with language master cards by the 
project director. These J^nguage'masters were used for indi- 
vidualized drill with the students. A record of drill acti- 
vities occurring at least once a week was made for the follow- 
ing percentage of the required frequency: 

December - 2% 

January - 62% 

February - 76% 

March . - 55% 

April - 46% 

May - 51% 
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Because the corresponding product objective was accomplished 
at both testings, the impact and appropriateness of the process 
cannot be determined. The evaluators suggest that when a review 
of objectives K-l. 5 is made to determine appropriateness, a 
review of objective K-l .5 should also occur. 

Ob j ective K-l . 6 ; 

At the conclusion of the year 50% of the students 
will associate the nouns and verbs found in pre- 
primers with their corresponding pictures . Their 
abilities will be measured by teacher ratings and 
observer checklists. 

Evaluation ; 

The students' ability to perform this objective was 
measured by having the teacher present them one picture card 
and three words. The students were asked to identify the 
word that matched the picture. The highest possible score 
on this test was three correct; a score of three was required 
to accomplish the objective. Table 46 summarizes the t-test 
for correlated data performed on the pre-test and post-test 
scores of this measure. 

The results of this test show that 5% of the students 
performed at the appropriate level on the pre-test and only a 
slightly larger percentage, 10%, performed at the appropriate 
level on the post-test. Similarly, no significant difference 
existed between the pre-test scores and the post-test scores. 

100 




Evaluation : 



The following percentages indicate the percentage of 
time during which the teachers provided appropriate acti- 
vities at least once a week: 

December 0% 

January 7% 

February 0% 

March - 10% 

April - 30% 

May - 21% 

A review of these percentages explains the lack of accom- 
plishment of objective K-1.6. The teachers rarely performed 
activities directed at this objective. The evaluators suggest 
that a review be made of the appropriateness of both product 
and process objective K-1.6. This will determine whether the 

objective is inappropriate for the kindergarten children or if 
lack of process activities sufficiently explains its status. 



Objective K-l . 7 : 



25% of the students when read orally a story 
from a standard English pre-primer will orally 
be able to say at least two of the following: 

1) Marne of three main characters; 2) Two main 
ideas; 3) Conclusion. This will be measured by 
teacher ratings and observer checklist. 



Evaluation : 



Table 47 summarizes the analysis of the results of the 
test used to measure objective K-l. 7; a t-test for correlated 



data was performed to compare the pre-test and post-test scores 
on this measure . 
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Table 47 

^Instructional Objective K-l .7 
N, X, SD, % at Criterion and t-ratio 





N= 17 






Pre Post 


X 
SD 
% at 


Criterion 


4.0508 4.9411 

0.9374 0.2360 

67 94 




Difference 
Between Means 
df 
t ' 


0.8823 

16 

4.2559* 


* <. 


001 





This objective was measured by reading the children the 
story "Little Duckling Tries His Voice" and asking a series of 
questions about it. The students were asked to name three of 
the characters the duckling met, to state the duckling's deci- 
sion, and to explain the reason for this decision. The highest 
possible score cn this test was five correct. A review of 
Table 47 indicates that 67% of the students could perform the 
objective on the pre-test, and 94% of the students could do so 
on the post-test? therefore, on both pre- and post-tests at 
least 25% of the students answered all questions correctly. In 
addition, a significant difference existed between the pre-test 
and post-test scores. These results suggest that perhaps the 
criterion level of 25% of the students is not appropriate. 
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Because a significant difference existed between the two sets of 
scores, the kindergarten program seemed to have some influence 
on the accomplishment of this objective. • The criterion level 
seems too low. Objective K— 1.7 was accomplished. 

Objective K-l . 7P 

The classroom teacher will evaluate each child 
individually at the beginning of the year and 
group children for instruction. Teachers will 
provide appropriate exercises and opportunities 
to perform at least once a week. These activi- 
ties will be recorded in the lesson plan book. 

Evaluation ; 

The teachers evaluated each child individually at the 
beginning of the year and grouped children for instruction; 
this was confirmed by classroom observation. The following 
percentages indicate the percent of time teachers provided 
appropriate activities at least once a week as specified in 
the process objective: 

December - 83% 

January - 92% 

February - 76% 

March - 80% 

April - 76% 

May - 40% 

These generally high frequencies of performing the; process 
activities stated in the objective suggest one reason for the 
significant difference between pre— and post-test scores. The 
frequent performance of the process suggests its importance to 
the kindergarten curriculum. This importance further indicates 
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a need to revise the criterion level in the product objective 
K-1.7. 

Objective K-l . 8 : 

25% of the students when read orally a story 
from a standard English pre-primer will at the 
conclusion of the story be able to arrange a 
list of 3 activities in their proper sequence 
given the activities orally. This will be 
measured by teacher ratings and observer check- 
lists. 

Evaluation : 

The ability of the students to do the activities specified 
in objective K-l. 8 was tested by reading the students the story 
"Little Duckling Tries His Voice" and asking them to put in 
sequence five cards representing the individuals the duckling 
met on his walk. The highest possible score on this measure 
was five correct; a score of three correct was required to 
accomplish the objective. Table 48 presents the analysis, a 
t-test for correlated data of the test scores. 

The results shown in Table 48 indicate that 50% of the 
students could sequence at least three activities properly 
on the pre-test, and 100% of the students could sequence at 
least threie activities properly on the post-test. Both pre- 
and post-test percentages of students were higher than the 
criterion percentage of 25% required by the objective. Simi- 
larly; no significant difference existed between the pre- and 
post-test scores. A review of this data suggests that the 



Table 48 

instructional Objective K-1.8 
N , X, SD, % at Criterion and t-ratio 



N= 17 





Pre 


Post 


X 


2.7647 


5.0000 


SD 


1.4360 


0.0000 


% at Criterion 


50 


100 



Difference 

Between Means 2.2353 

df 16 

t 1.5566* * 



* Not Significant 



criterion level of objective K-1.8 was not appropriate as the 
students had accomplished it on the pre-test. Objective K-1.8 
was accomplished. 



Objective K-1.8P ; 

• The teacher will evaluate each child individually 
at the beginning of the year and group children 
for instruction. Teachers will provide appropriate 
exercises and opportunities to perform at least 
once a week. These activities will be recorded in 
the lesson plan book. 



Evaluation : 



Children in the kindergarten classes were evaluated inform 
ally or formally on their ability ..to sequence activities in a 
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story at the beginning of the year. They were then grouped for 
instruction by the teachers. Appropriate exercises were provid- 
ed at least once a week for the following percentage of time: 

December - 33% 

January - 77% 

February - 76% 

March - 15% 

April - 76% 

May - 47% 

During three of the six months for which process was recorded, 
activities directed toward objective K-1.8 were performed three- 
fourths as often as specified. During three of the months, how- 
ever, very few teachers performed activities related to objective 
K-1.8 as frequently as required. This perhaps explains the lack 

of significant difference between the pre-test and post-test 

'} • 

scores. Th« evaluators suggest that a review be made of the 
process K-1.8 and the frequency at which it should be performed 
in addition to the appropriateness of product objective K-1.8. 

Obj ective K-l . 9 : 

25% of the students will be able to repeat cor- 
rectly in proper English a five ;word sentence 
dictated in English by the teacher utilizing 
words from the Barbe and Dolch lists. This 
will be measured by teacher rating and observer 
checklist. 

Evaluation : 



The ability of students to repeat a five-word sentence was 
measured by having the child repeat such a .sentence after the 
teacher. Five sentences were presented to .the child; there- 
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fore, the highest possible score was five correct. Table 49 
summarizes the t**test for correlated data done on these pre- 
test and post-test scores. 



Table 49 

instructional Objective K-1.9 
N, X, SD f % at Criterion and t-ratio 





N= 17 




Pre 


Post 


X 

SD 
% at 


4.4117 

1.2395 

Criterion 72 


4.6470 

0.7625 

77 




Difference 
Between Means 
df 
t 


0.2353 

16 

1.0008* 



* Not significant 



The results shown in Table 49 indicate that approximately 
the same percentage of students could perform the objective on the 
pre-test and post-test, 72% and 77% respectively. Similarly, no 
significant difference existed between the pre-test and post- 
test scores. The ability of the students to repeat words 
stated by the teacher seemed to be a skill they possessed when 
they entered the classroom, as indicated their accomplishment 
of other similar objectives on,the pre-testing. The evaluators 

■ r. » . 

reco mm end that a review be made of the appropriateness for 
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kindergarten students o£ objectives involving repetition of 
words. 



Objective K-l . 9P : 



The classroom teacher will evaluate each child 
individually at the beginning of the year and 
group children for instruction. Teachers will 
provide appropriate exercises and opportunities 
to perform at least once a week. These activi- 
ties will be recorded in the lesson plan book. 



Evaluation : 



Teachers performed appropriate activities for instruct- 
ional objective K-l. 9 the following percentage of the time 
required : 



These percentages indicate that the teachers were generally 
not performing activities geared toward objective K-l. 9 at least 
once a week. This may explain the lack of a significant differ- 
ence between pre and post scores for the corresponding product 
objective, although the inappropriateness of the objective may be 
a better explanation. 

Ob j ective K-l . 10 : 

25% of the students will be able to make up in 
English simple endings for stories dictated in 
English by the teacher. This will be measured 
by teacher ratings and observer checklists . 



December 

January 

February 

March 



33% 

61% 

30% 

65% 

92% 

57% 



April 

May 
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Evaluation : 



In order to measure this objective the teacher read the 
story "The Strange Noise” to a group o£ students or to each 
student individually and asked each child to make up their own 
ending to the story. The students^were rated as to whether 



story. Table 50 indicates that 68% of the students received 
a positive rating on the pre-test, and 95% received a positive 
rating on the post-test. A sign test for correlated data was 
performed between the pre-test and post-test ratings to deter- 
mine if a difference between them existed; this analysis is 
summarized in Table 50. 

Table 50 reports that a significant difference existed 
bejtyeen the pre-test and post-test scores. These results 
suggest that the program had an impact on the students' ability 
to do the skill cited in objective K-1.10, and that the cri- 
terion level of the objective was probably too low. The eval- 
uators suggest a review of the objective be made to determine 
the appropriateness of the criterion and appropriate changes 
implemented. 



they could or could not make up an appropriate ending to the 
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Table 50 



Instructional Objective K-1.10 
Summary of Sign Test for Correlated 
Data and Percent at Criterion Level 



Number with Pre and Post Scores 
Number Showing Positive Change 
Number Showing Negative Change 



21 

7 

0 



z 



2.2677 

<.05 



P 



% at Criterion-Pre 
% at Criterion-Post 



68 

95 



Objective K-1.10P ; 



The classroom teacher will dictate stories in 
English. Children in small groups will then be 
allowed to work out a story ending. Later in 
year students will each work out their story 
endings. These activities will be recorded at 
least once a week and recorded in the lesson 
plan book . 



Evaluation : 



Classroom teachers dictated stories in English and had 
students work out story endings at least once a week for the 
following percentage of required time: 



i 



December - 50% 
January - 38% 
February - 69% 
March - 60% 
April - 92% 
May - 57% 



i 
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Generally, the teachers were doing process activity K-1.10P 
at least one-half as frequently as they should have been. This 
seemed to be a sufficient frequency of process since a signi- 
ficant difference existed between the pre-test and post-test 
scores. 

Objective K-2.1 : 

100% of the students will develop tactual percep- 
tion to the point that they can distinguish by 
touch differences in texture, hardness, size. 

Their skills will be measured by teacher rating 
and observer checklists . 

Evaluation : 

The tactual perception skills of the children were measured 
in the following way: the student was blindfolded; two objects 

were placed in front of him; he was requested to compare them in 
terms of either hardness, size or weight; four such pairs of 
objects were presented yielding a possible score of four correct. 
Table 51 summarizes the comparison of the pre-test and post- 
test scores through a t-test for correlated data. 

The data summarized in Table 51 report that on the pre- 
test 94% of the students answered all questions correctly, and 
on the post test 100% of the students answered all questions 
correctly. Therefore, only on the post-test did the class meet 
the criterion level of 100% specified in the objective. Because 
of the high mean pre-test score, however, no significant difference 
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Evaluation: 

The teachers did prepare "Surprise Boxes" and used these 
boxes at least once a week for the following percentage of the 
required time : 

December -83% 

January - 69% 

February - 76% 

March - 80% 

April -.84% 

May - 70% 

Almost three-fourths of the time during which such activi- 
ties were supposed to occur did they actually occur at least 
once a week. This frequency suggests the appropriateness of 
process K-2.1P for achieving K-2.1 and also the importance of 
this activity as part of the curriculum. 



Objective K-2 . 2 : 



80% of the children will correctly complete acti- 
vities involving the following visual perception 
skills: left-right progression , utilization of 

peripheral vision, focusing the eyes with head 
in motion, focusing the eyes with head station- 
ary, following regular movements , following 
irregular movements. These abilities will be 
measured by teacher rating and observer check- 
lists. 



Evaluation s 



Th^s objective was measured by a series of tasks involv- 
ing movement and location of plastic toy cards and straws. 
Each of the six questions tested one of the visual skills 







Table 51 



—Instructional Objective K-2.1 
N, X, SD, % at Criterion and t-ratio 



N= 17 






Pre 


Post 


X 

SD 
% at 


Criterion 


4.0000 

0.0000 

94 


4.0000 

0.0000 

100 




Difference 
Between Means 
df 
t 




0.0000 

16 

0.0000* 



* Not Significant 



existed between the pre-test scores and the post-test scores. 
Objective K-2.1 would seem to be an appropriate objective because 
only on the post-test was the criterion level met; however, the 
evaluator suggests that a review of the objective occur because 
of the high score received on the pre-test by so many of the 
program participants . Objective K-2.1 was accomplished. 



Objective K-2 . IP : 



Process. The teacher will prepare "Surprise Boxes" 
with a hole for inserting the hand. Inside the 
box will be three objects of different hardness or 
texture, etc. The child will be asked by touch to 
identify and remove the softest, etc. These acti- 
vities will be performed at least once a week and 
recorded in the lesson plan book. 
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specified in the objective. The results in Table 52 summarize 
the analysis of scores of the students on this objective; a 
t-test for correlated data was used to compare pre-test and 
post-test scores. In order to accomplish the objective, stu- 
dents were required to receive a score of six correct out of 
six possible points. 

Table 52 

Instructional Objective K-2.2 
N, X, SD, % at Criterion and t-ratio 





N= 17 






Pre 


Post 


X 

SD 
% at 


Criterion 


4.7647 

0.8764 

11 


5.2941 

0.6655 

41 




Difference 
Between Means 
df 
t 


0.5294 

16 

2.0455* 



* Not Significant 



Table 52 indicates that 11% of the students received a 
score of six on the pre-test, and 41% of the students received 
a score of six on the post-test; no significant difference 

existed between the pre-ihest and post-test scores. These results 

! * ' ■ 

suggest that the process for accomplishing objective K-2.2 wa 3 
either not appropriate or was not performed with satisfactory 
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frequency. Review of the evaluation of process K-2.2P may 
indicate which situation existed. The evaluators also suggest 
that a review of objective K-2.2 should occur, with consideration 
of the appropriateness of the 80% criterion level specified in 
the objective. Objective K-2.2 was not accomplished. 



Objective K-2.2P ; 



The classroom teacher will evaluate each child 
individually at the beginning of the year and 
group children for instruction. Teachers will 
provide appropriate exercises and opportunities 
to perform at least once a week. These activi- 
ties will be recorded in the lesson plan book. 



i 1 ' 



Evaluation : 



ij; 






£' 

u • 

■ \r 




Each child was evaluated individually at the beginning of 

the year, and children were grouped for instruction by the 

teachers. Appropriate exercises were provided at least once a 

week during the following percentage of time: 

December - 66% 

January - 84% 

February - 92% 

March - 95% 

April - 84% 

May - 80% 

The high percentage of performing the process activity 
specified in the objective suggest that either a marked increase 
in frequency of activity per week should occur or the appropriate 
ness of the particular activities should be assessed. If 
indeed these activities were appropriate for the product 
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ob]6ctiv&r bhsn sons change in tbs product objsctivs criter— 
ion level may be the appropriate action. 



Objective K-2 . 3 ; 



80% of the children will complete activities 
involving the following perceptual constancy 
skills: same size, different size, sorting by 

size, same shape, sorting according to shape. 
This will be measured by teacher ratings and 
observer checklists. 



Evaluation : 

Objective K-2. 3 was measured by placing a series of cir- 
cles and squares in front of the child and having him identify 
those that were the identical in size, different in siz 6 , iden- 
tical in shape, different in shape, and by having him sort them 
by size and by shape. The highest possible score a child could 
receive was five correct, the score necessary to accomplish 
the objective. Table 53 indicates the results of this test 
and summarizes the t-test for correlated data performed on 
the two sets of scores. '* 



The results shown in Table 53 indicate that 53% of the 
students could perform objective K-2. 3 on the pre-test, and 
82% of the students could perform it on the post-test. The 
post-test percentage exceeds the 80% required by the objective; 
therefore, objective K— 2.3 was accomplished. However, no sig- 
nificant difference existed between the pre-test and post-test 
scores. This suggest that a review of the ability of the 
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Evaluation: 

Observation of classes and reports from classroom teachers 
indicated that students were evaluated individually at the begin- 
ning of the year on this ability and grouped for instruction. 
Teachers provided appropriate exercises and opportunities to per- 
form at least once a week for the following percentage of weeks: 

December - 33% 

January - 46% 

February - 76% 

March - 75% 

April - 84% 

May - 70% 

These percentages suggest that as the program progressed the 
process activity was done with greater frequency. During the lat' 
ter months it was performed with three-fourths the anticipated 
frequency. However, the fact that objective K-2.3 was accom- 
plished verifies the appropriateness of objective K-2.3P and the 
appropriateness of the frequency with which it was performed. 

Objective . K-2 .4 : 

80% of the children will complete activities 
involving the following spacial skills: behind, 

over, beside, under, inside. This will be mea- 
sured by teacher rating and observer checklist. 

Evaluation : 

Table 54 presents the results of the measurement of object- 
ive K-2. 4; a t-test for correlated data was used to compare the 
pre-test and post-test scores. 




Table 54 



Instructional Objective K-2.4 
N r X, SD, % at Criterion and t-ratio 



N= 17 




Pre 


Post 


X 

SD 
% at 


1.5294 

1.0910 

Criterion 5 


2.8235 

1.8225 

21 




Difference 
Between Means 
df 
t 


1.2941 ' 

16 

3.0328* 



* <.01 



This objective relating to acquisition of spacial relation- 
ship concepts was tested by having the students place a popsicle 
stick in a series of five positions in relationship to the cup. 
The highest possible score a student could receive was five. The 
results shown in Table 54 indicate that 5% of the students could 
do the required tasks on the pre-test , and 21% of the students 

could do the required tasks on the post-test. The post-test 

./ 

percentage did not reach that specified in the objective; however 
a significant difference existed between the pre-test and post- 
test scores. These . results suggest that the criterion percentage 
of 80% for this objective may be too high for this student popu- 
lation. The evaluators suggest that a review of objective K-2.4 
occur. Objective K-2.4 was not accomplished. 

123 120 : 



Objective K-2 . 4P : 



The classroom teacher will evaluate each child 
individually at the beginning of the year and 
group children for instruction. Teachers will 
provide appropriate exercises and opportunities 
to perform at least once a week. These activi- 
ties will be recorded in the lesson plan book. 



Evaluation ; 

Children were individually evaluated and grouped for instruc- 
tion at the beginning of the year . The occurrence of this pro- 
cedure was confirmed by interviews with teachers and classroom 
observation. Teachers provided appropriate exercises for the 
accomplishment of objective K-2.4P at least once a week during the 
following percentage of time: 



December - 50% 
January - 61% 
February - 53% 
March - 70% 
April - 84% 
May - 68% 



These percentages indicate that the teachers were performing 
appropriate activities at least once a week during one-half to 
three-fourths of the time. Because a sufficient percentage of 
students did not achieve the objective even though a significant 
difference existed between the pre-test and post-test scores, the 
evaluators conclude that process activity K-2. 4 was appropriate, 
but was not performed with satisfactory frequency. 



i 

< 

I 
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Objective K-2 . 5 ; 

100% of the children will develop their sense of 
smell to the point that they can distinguish and 
correctly identify boxes covered with cheesecloth 
which contain onions , potatoes , celery , apples, 
ripe bananas, and oranges. This will be measured 
by teacher ratings and observer checklists. 

Evaluation ; 

In order to measure objective K-2. 5 students were asked 
to select from six bottles those three pairs of bottles which 
had identical scents; therefore, the highest possible score a 
student could receive was three correct. Table 55 summarizes 
the analysis of these test results; a t-test for correlated data 
was performed to compare the pre-test and post-test scores. 

The results shown in Table 55 indicate that 47% of the stu- 
dents could perform the activities specified in this objective 
on the pre-test, and a larger percentage, 64%, could perform the 
specified activities on the post-test. The post-test criterion 
was not accomplished, however, as 64%, less than the required 
100%, of the students performed satisfactorily. No significant 
difference existed between the pre-test and post-test scores. 
These results suggest that the process used for teaching the 
objective or the test used to measure it may not have been appro* 
priate. A review of the scents used in measuring this objective 
indicate the scents of peppermint, perfume, and antiseptic which 
the students were required to identify were not those specified 
in the original objective. The evaluators suggest that the 
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Table 55 



instructional Objective K-2.5 
N, X, SD, % at Criterion and t-ratio 



N= 15 





Pre 


Post 


X 


1.9019 


2.3215 


SD 


1.6527 


2.1233 


% at Criterion 


47 


64 



Difference 

Between Means 0.4196 

df 14 

t 0.6628* 



* Not Significant 



teachers refer to the original objective and determine if it 
is appropriate. A review of the process should also be made 
and appropriate changes implemented. Objective K-2.5 was not 
accomplished. 



Objective K-2 . 5P : 



The project director will provide teachers with 
30 cardboard boxes (shoe boxes) which have a hole 
cut in the cover which is covered with cheesecloth. 
The teacher will make up sets of boxes, each set 
containing five boxes, each with a different mater- 
ial inside. Students will be grouped, each group 
receiving a set of boxes. This activity will be 
performed at least every two weeks. The activi- 
ties will be recorded' in the lesson plan book. 



i 
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Evaluation : 



The project director did not provide the teachers with 
the cardboard boxes specified in the objective , because teachers 
already had similar boxes with different materials inside. Sub- 
stitution for the specified materials explains the substitution 
of the different set of materials for those specified in object- 
ive K-2.5. The set of materials selected by the teachers to 
test were also those used in the activities specified in object- 
ive K-2 . 5P , which were performed at least every 2 weeks for the 
following percentage of available time: 

December - 2% 

January - 46% 

February - 53% 

March - 40% 

April - 38% 

May - 32% 

These percentages indicate that activities directed toward 
objective K-2.5 were not performed with even one-half of the 
specified frequency. The evaluators recommend that the project 
staff review objectives K-2.5 and K-2.5P to determine their appro- 
priateness and to consider which materials should be used as \ 

the focus for developing this sense of smell. 

' \ 

Objective K-2. 6 : 



75% of the children will by the end of the year 
have developed their gross motor skill as demon- 
strated by their ability to perform 50% of the 
following activities: regaining an upright posi- 

tion from sitting position; lying on backs; lying 
on stomachs; crawling; skipping; galloping; hop- 
ping; balancing. This will be measured by teacher 
ratings and observer checklists. 
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Evaluation : 



In order to measure objective K-2.6 the students were 
asked to perform each of the motor-coordination skills specified 
in the objective. Because they were asked to demonstrate seven 
different skills , the highest possible score they could receive 
was seven correct. 



Table 56 

Instructional Objective K-2.6 
N, X, SD, % At Criterion and t-ratio 





N= 17 




Pre 


Post 


X 

SD 

% at 


4.1764 

2.1485 

Criterion 58 


6.2352 

1.4657 

52 




Difference 
Between Means 
df 
t 


2.0588 

16 

2.0588* 



* Not Significant 



Table 56 summarizes the results of this seven-question 
test; a t-test for correlated data was used to analyze the* two 
sets of scores. Students were required to receive a score of 
four, or 50% of the activities, to satisfy the objective. The 
table shows that 58% of the students received appropriate scores 



* 
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on tiie pre-test; only 52% of the students received appropriate 
scores on the post-test. No significant difference existed 
between the pre-test and post-test scores. The 52% of students 
who achieved the objective on the post-test was too low for the 
objective to be accomplished because it specified a 75% cri- 
terion level. In spite of the fact that a smaller percentage 
of students reached the performance level on the post-test than 
on the pre-test, the mean score on the post-test was higher than 
on the pre-test. This suggests that a wide range of scores, 
four to seven correct, which students could receive to accom- 
plish the objective did not sufficiently discriminate between 
students with different abilities. The evaluator recommends that 

A 

the program review this objective and determine the appropriate- 
ness of the criterion percentages in the objective. 

Objective K-2.6P ; 

The classroom teacher will evaluate each child 
individually at the beginning of the year and 
group children for instruction. Teachers will 
provide appropriate exercises and opportunities 
to perform at least once a week. These activi- 
ties will be recorded in the lesson plan book. 

Evaluation : 

Classroom teachers evaluated each child individually, either 
formally or informally at the beginning of the year and grouped 
them for instruction. They performed appropriate activities for 
the accomplishment of objective K-2.6 at least once a week dur- 
ing the following percentage of available time: 
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December - 66% 
Januafy - 92% 
February - 92% 
March - 100% 



- 100 % 
- 100 % 
- 82% 



April 

May 



The high frequency of performance of the process acti- 
vity suggests that the particular activities may not have been 
appropriate for the accomplishment of objective K-2.6. The 
evaluators suggest that a review be made of process used in each 
kindergarten classroom for the achievement of objective K-2.6. 

Objective K-2 , 7 : 

50% of the children by the end of the year will 
have developed their fine motor coordination, as 
demonstrated by their ability to perform three 
of the followng five activities: cutting, placing 

and tracing, buttoning, zipping. Their abilities 
will be measured by teacher rating and observer 
checklist . 

Evaluation : 

Table 57 summarises the analysis of the t— test for corre- 
lated data performed on the results of the testing for objective 
K-2. 7. 

Students were tested on this objective by being insturcted 
to draw several geometric figures, to cut them out of a piece 
of construction paper; to button a shirt, and to zip a jacket 
on the board. The highest possible score a student could receive 
was four correct. Students were required to earn a score of 
three to accomplish the objective. Table 57 indicates that 




Table 57 



_Instructional Objective K-2.7 
N, X, SD, % at Criterion and t-ratio 



N= 18 





Pre 


Post 


X 


3.6666 


4.0000 


SD 


0.4715 


0.0000 


% at Criterion 


100 


100 



Difference 
Between Means 
df 
t 



0.3334 

17 

0.7071* 



* Not Significant 

100% of the students could accomplish the objective on the pre- 
test, and 100% of the students could accomplish the objective on 
the post-test. These percentages suggest that this objective is 
not appropriate for the kindergarten children as all students 
possessed this ability when they entered the classroom. No sig- 
nificant difference existed between the pre-test and post-test 
scores. The evaluators suggest that this objective be eliminated 
from the project because of the ability of the children to do it 
when they entered kindergarten, objective K-2.7 was accomplished 
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Objective K-2.7P : 



The classroom teacher will evaluate each child 
individually at the beginning of the year and 
group children for instruction. Teachers will 
provide appropriate exercises and oppotunities 
to perform at least once a week. These activi- 
ties will be recorded in the lesson plan book. 



Evaluation : 



Students were evaluated individually at the beginning of 
the year and grouped for instruction. Discussion with teachers 
and classroom observation confirmed the occurrence of these acti- 
vities. Teachers provided appropriate exercises for the skills 
required in objective K-2.7 at least once a week fo> the follow- 
ing percentage of time: 

December - 100% 

January - 100% 

February - 100% 

March - 100% 

April - 100% 

May - 84% 

The fact that these teachers performed process K-2.7P as 
frequently as they did suggests that these activities may have 
reinforced the abilities possessed by the students when they 
entered kindergarten. It is questionable whether such a high 
frequency of performing there activities was required, although 
these activities most probably occurred informally during other 
instruction. This can only be answered by reviewing both product 
and process objective K-2.7. The evaluators recommend that such 
a review occur. 



n 




7 



Table 58 indicates that 33% of the students received a 
score of two required by the criterion specified in the object- 
ive on the pre-test, and 71% of the students obtained such 
a score on the post-test. Neither on the pre-test nor the 
post-test did a sufficient percentage of students achieve the 
objective to satisfy the 100% criterion level. However, it 
should be noted, as summarized in Table 58, a t-test for cor- 
related data between pre and postt scores showed a significant 
difference existed between the scores, a difference which could 
have occurred by chance less than one time in 100. The result 
suggests that , in spite of the fact that the criterion level 
of the objective was not accomplished , the program did have some 
impact on the students' abilities to identify like sets. The 
evaluators recommend, based on this evidence, that the project 
review the appropriateness of the criterion specified in this 
objective. Objective K-2.1 was not accomplished. 

Objective K-3 . IP : 

Process. The students will be provided by the 
teacher with the worksheet containing three pic- 
tures in each example. The student will link 
the matching pictures with a line. This acti- 
vity will occur at least once a week and will 
be recorded in the lesson plan book. 

Evaluation ; 

The teachers provided the students with worksheets contain- 
ing three pictures in each example. The students were required 

1.34 H-. 
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to link identical pictures with a line. The frequency with whittli 

this activity was performed at least once a week was as follow?;: 

December - 83% 

January * 52% 

February - 52% 

March - 70% 

April - 76% 

May - 57% 

These percentages suggest that generally three-fourths of the 
time specified for objective K-3.1P was actually devoted to it. 
However, because they were not doing the process as frequently 
as they should have been may explain the lack of accomplishment 
of the corresponding product objective . The appropriateness of 
the process activities performed seems evident from the fact 
that a significant difference between the pre- and post-test 
scores of objective K-3.1 occurred. The evaluators recommend that 
the project review the frequency of process K-3.1 and for 1971-72 
consider performing it more frequently than during the current 
project year. 

Objective K-3 . 2 : 

Given a diagram containing a representation of a 
number 0-10, 50% of the class will 80% of the time 
be able to orally name the corresponding number. 

This will be measured by teacher rating and obser- 
ver checklist. 

Evaluation : 

Ta b le 59 shows the results of the evaluation of objective 
K-3.2; a t-test for correlated data was used to compare the pre- 
test and post-test scores . 



finding suggests that participation in the program contributed 
to the accomplishment of objective K-3.2 by a larger percentage 
of students them required in the objective. The evaluators 
suggest that the project review the criterion percentage 
established in the objective and consider raising it. 

Obj ective K-3.2P : 

The classroom teacher will evaluate each child 
individually at the beginning of the year and 
group children for instruction. Teachers will 
provide appropriate exercises and opportunities 
to perform at least once a week. These acti- 
vities will be recorded in the lesson plan book. 

Evaluation : 

The classroom teacher evaluated each child individually at 
the beginning of the year and grouped children for instruction. 
This was confirmed by classroom observation and teacher inter- 
views. Appropriate exercises were provided at least once a week 
with the following frequency: 



The fact that process K-3.2 was performed with such high 
frequency explains the significant difference between pre-test 



December - 100% 
January - 100% 
February - 100% 



March 

April 

May 



95% 

100 % 

85% 



and post— test scores on the corresponding product objective 
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Objective K-3.3 ; 

, 90% of the students will understand the number 
'concepts 0 to 10. This will be measured by 
teacher rating and observer checklist. 

Evaluation : 

Students were asked to draw objects representing the num- 

•• 

bers 0 to 10 on a sheet of paper. The highest possible score 
that the student could receive was eleven correct. A t-test for 
correlated data was used to compare the pre-test and post-test 
scores; this analysis is summarized in Table 60. 



Table 60 



_ Instructional Objective K-3.3 
N, X‘, SD, % at Criterion and t-ratio 



N= 17 



Pre 



Post 



X 

SD 

% at Criterion 



8.7058 

2.2167 

61 



10.0000 

0.0000 

100 



Difference 
Between Means 



1.2942 

16 

0.5838* 



df 

t 



* Not Significant 
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Table 60 reports that 61% o£ the students could do objec- 
tive K-3.3 on the pre-test; 100% o£ the students could perform 
it on the post-test. The criterion of 90% of the class which 
had to perform the objective was thus reached during the program 
year. . A significant difference did not exist between the pre- 
test and post-test scores , suggesting that the students performed 
quite well on the pre-test , but did not receive the perfect score 
that was required for accomplishment of the objective. Objective 
K-3.3 was accomplished. 

Objective K-3 ,3P; 



The classroom teacher will evaluate each child 
individually at the beginning of the year and 
group children for instruction. Teachers will 
provide appropriate exercises and opportunities 
to perform at least once a week. The activities 
will be recorded in the lesson plan book. 



Evaluation : 



Children were individually evaluated either formally or 
informally at the beginning of the classroom instruction and 
grouped for instruction. Appropriate exercises were provided 
at least once a week for the following percentage of available 
time: 



December - 66% 

January - 77% 

February - 76% 

March - 90% 

April - 100% 
May - 81% 
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The fact the product objective K-3.3 was accomplished sug- i 

gests that this frequency of performance of the process was 

i 

satisfactory. Similarly, the activities included in this pro- j 

cess seemed appropriate for the accomplishment of the corres- 
ponding product objective. 

Objective K-3 . 4 ; 

Given a visual representation showing the pattern 
of a given series of objects, 90% of the class 
will be able to correctly draw, the next object in 
the series 80% of the time. This will be measured 
by teacher rating and observer checklist. 

Evaluation ; 

This objective was tested by having the teacher place three I 

patterns of circles and squares on the board and asking the child j 

to finish each pattern; the highest possible score a student 
could receive was three correct. Since he had to perform the j 

activity 80% of the time, in order to satisfy the criterion the j 

student had to recrive a perfect score of three to accomplish the 

i ’ \ 

objective. The results shown in Table 61 summarize the t-test j 

for correlated data performed on the scores. 

! i 

; { 

Table 61 notes that 47% of the students received a score 
of three on the pre-test, and 73% of the students received it 
! on the post-test, too low a percentage to satisfy the objective. 

i 

i A significant difference did exist between the pre-test scores 

i ... ’ . 

| and post-test scores . This suggests that perhaps a review of 

i. ■' ; 
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Table 61 



instructional Objective K-3 . 4 
N, X, SD, % at Criterion and t-ratio 



N= 17 



Pre 



Post 



X 

SD 

% at Criterion 



2.1176 

1.0782 

47 



2.6470 

0.8361 

73 



Difference 
Between Means 



0.5294 

16 

2.3158* 



df 

t 



* <.05 



the required criterion level should be considered; 90% may be 
too high. Objective K-3. 4 was not accomplished. 



Objective K-3 .4P : 



The classroom teacher will evaluate each child 
individually at the beginning of the year and 
group children for instruction. Teachers will 
provide appropriate exercises and opportunities 
to perform at least once a week. These activi- 
ties will be recorded in the lesson plan book. 



Evaluation : 



Observations of classrooms confirmed that each teacher 
evaluated their students individually and grouped the children 
for instruction. They provided appropriate exercises for the 
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accomplishment of objective K-3.4 at least once a week for the 



of required 


time: 


December - 


50% 


January - 


61% 


February - 


100% 


March - 


80% 


April 


84% 


May - 


55% 



During the second part of the school year, the teachers did 
the process with varying frequencies. This may explain the dif- 
ference between pre- and post-test scores and the failure to 
achieve the criterion. Activities may have been appropriate, but 
not performed frequently enough. A review should be made of 
these possibilities. 

Objective K-3 . 5 ; 

Given two sets of objects containing 1 to 10 
items, 90% of the class will be able to combine 
the sets and orally name the correct number 
of objects in the new set 90% of the time. 

This will be measured by teacher ratings and 
observer checklists. 

Evaluation : 

This objective was measured by placing a set of blocks in 
front of the child, then adding to or subtracting from the blocks 
in the set and requiring the student to name the number of blocks 
in the new set. This activity was repeated ten times with dif- 
ferent sets so that the highest possible score which could be 
obtained by the student was ten. 
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Objective K-3 . 5P : 



The classroom teacher will evaluate each student 
individually at the beginning of the year and 
group children for instruction. Teachers will 
provide appropriate exercises and opportunities 
to perform at least once a week. These activi- 
ties will be recorded in the lesson plan book. 

c 

/ 

Evaluation ; / 

At the beginning of the year each child was evaluated indi- 
vidually, and the class was organized into groups for instruction. 
Teachers provided appropriate exercises at least once a week for 
the following percentages of the time: 



Since objective K-3 . 5 was accomplished the frequency and 
appropriateness of process K-3.5P was evidenced. Although 
teadhers generally did not always perform the activities once a 
week, the frequency with which they were performed seemed suffi- 
cient; perhaps the frequency of process in this case should be 
more flexible in next year ' s process objective . 



Objective K-3 . 6 : 



Given a set of objects containing 2 to 10 objects 
and directed to remove a stated number of objects, 
90% of the students will be able to separate- the 
set and orally name the correct number of objects 
in the new set. This will be measured by teacher 
rating and observer checklists. 



December - 
January - 
February - 
March 
April 
May 



83% 

84% 

53% 

80% 

100 % 

58% 
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Evaluation : 



Students were given nine tasks involving either addition or 
subtraction of a certain number of marbles from a set displayed 
on the abacus. After the additon or subtraction activity had 
been performed, the student was requrest to orally name the num- 
ber of marbles left in the new set. The highest possible score 
in this activity was nine correct. A t-test for correlated data 
summarized in Table 63 was used to compare the pre-test and post- 
test scores. 

Table 63 

Instructional Objective K-3.6 
N, X, SD, % at Criterion and t-ratio 



N= 14 





Pre 


Post 


X 


7.2857 


8.5714 


SD 


2.8139 


0.9036 


% at Criterion 


59 


82 



Difference 

Between Means 1.2857 

df 13 

t 1.8614* 



* Not Significant 

Table 63 indicates that 59% of the students received a score 
of nine required by the objective on the pre-test, and 82% of the 
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student 3 received an appropriate score for accomplishing the 
objective on the post-test. The 82%, however, was not suffi- 
ciently high to consider the objective accomplished. Similarly, 
a significant difference did not exist between the pre-test and 
post-test scores. The evaluators suggest that a refocusing of 
this objective occur, with consideration of the appropriateness 
of the specified criterion level. A review of the process should 
also be considered in determining its appropriateness as an 
explaination for the lack of change of growth in this objective. 
Objective K-3.6 was not accomplished. 



Objective K-3.6P ; 



The classroom teacher will evaluate each child 
individually at the beginning of the year and 
group children for instruction. Teachers will 
provide appropriate exercises and opportunities 
to perform at least once a week. These activi- 
ties will be recorded in the lesson plan book. 



Evaluation : 

\ 

i 

The classroom students were evaluated individually at the j 

beginning of the year and organized into groups for instruction. 

1 

Appropriate exercises were provide at least once a week during j 

i 

the following percentage of the required time: j 

i 

December - 66% j 

January - 52% 

February - 61% 

March - 70% 

April. - 69% 

May - 41% 
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The fact that product objective K-3 . 6 was not accomplished 
suggests that the frequency with which this process activity was 
performed was not satisfactory. Another possibility was that 
the activities involved in this process were not appropriate. 

A review of the process used for accomplishing objective K-3. 6 
should be undertaken, and appropriate revisions made for the 
next program year. 

Ob j ective K-3 . 7 ; 

Given an array of geometric shapes, circles, tri- 
angles, and rectangles, 80% of the students will 
be able, given the name of a shape, to remove 
from the set all matching shapes 90% of the time. 

This will be measured by teacher rating and obser- 
ver checklists. 

Evaluation : 






This objective was tested by providing the students with ^ 
an envelope containing an array of circles , triangles , rectangles 
and' squares. The teacher named the shape and asked the child to 
remove from the set all matching shapes for the one named. The 
highest possible score a student could receive was four. Table 
64 summarizes the results of the analysis of these test scores 
a t-test for correlated data. 



The results shown in the Table 64 indicate that on the pre- 
test 61% of the students received a score of four required by the 
objective, while on the post-test 96% of the students received 
the required score of four. This percentage on the post-test was 
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Table 64 



^Instructional Objective K-3.7 
N, X, SD, % at Criterion and t-ratio 





N= 18 




Pre 


Post 


X 


3.0000 


3.9444 


SD 


1.3743 


0.2293 


% at Criterion 


61 


96 


Difference 






Between Means 


0.9444 


df 




17 


t 




3.0722* 


* <.01 



sufficient to consider the objective accomplished. Similarly, a 
significant difference existed between the pre-test and post-test 
scores, a difference which could have occurred by chance less 
than one time in 100. These results suggest that the instruc- 
tion during the kindergarten year contributed to the accomplish- 
ment of this objective by the kindergarten students. Objective 
K-3.7 as stated seems to be an appropriate one for the kinder- 
garten group. Objective K-3.7 was accomplished. 



Objective K-3.7P : 



The project director will provide each teacher 
with sets of geometric shapes. The teacher 
will provide appropriate practice at least once 
a week. These activities will be recorded in 
the lesson plan book. 
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Evaluation : 



A set of geometric shapes was not provided for the teachers 
by the project director because each classroom already had a set 
of such shapes. The teachers provided appropriate practice at 
least once a week for the following percentage of available 
time : 

December - 63% 

January - 61% 

February - 53% 

March - 75% 

April - 92% 

May - 50% 

These percentages show that the teachers were performing 

v; 

appropriate activities for one-half to nine-tenths of the required 
time. This seems to be an appropriate frequency for the perfor- 
mance of the process activities because the product objective 
K-3.7 was accomplished and because a significant difference 
existed between the pre-test and post-test results. Similarly , 
the activities used in the classrooms seemed to be appropriate 
for attaining the objective. 



Objective K-3 . 8 : 



Shown a geometric shape , circles , triangles, 
and rectangle, 80% of the students will be 
able to state orally its name. This will be 
measured by teacher ratings and observer 
checklist. 
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Evaluation : 

In order to measure objective K-3. 8, the students were shown 
a series of four flash cards which pictured a circle, triangle, . 
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Table 65 



Instructional Objective K-3.8 
N , X f SD f % at Criterion and t-ratio 



N= 13 



Pre 



Post 



X 

SD 

% at Criterion 



2.7692 

1.0490 

24 



3.3846 

0.6248 

52 



Difference 
Between Means 



0.6154 

12 

2.8891* 



df 

t 



* <.05 



rectangle, and square respectively. The student was asked to 
name the shape pictured on the flash card. Table 65 shows that 
24% of the students could do this task on the pre-test, while 
52% of the students could do this activity on the post-test. 
Neither percentage was sufficient to consider objective K-3.8 
accomplished. However, the t-test for correlated data summa- 
rized in Table 65 reported that a significant difference existed 
between the pre-test and post-test scores , suggesting that the 
criterion level established for this objective may be too high. 
The evaluators suggest that a review of objective K-3.8 occur, 
with emphasis on a determination of the appropriateness of the 
criterion level of 80%. 




Instructional Objective K-3.8P ; 



Appropriate practice in large groups followed by 
individualized instruction on the language master. 
The teacher will develop the language master cards. 
Practice will be provided at least once a week. 
Activities will be recorded in the lesson plan 
book . 



Evaluation : 

Appropriate practice in large groups followed by individ- 
ualized instruction was provided at least once a week for the 
following percentage of available time: 

December - 83% 

January - 69% 

February - 61% 

March - 85% 

April - 92% 

May - 67% 

These percentages do not seem to be sufficient for the accom- 
plishment of the objective. The appropriateness of the activi- 
ties, however, are suggested by the fact that a significant 
difference existed between the pre-test and post-test scores. 

The degree of individualization of instruction seemed to vary, 
as indicated by the differing frequency of use of the language 
master cards (refer to evaluation of equipment usuage below) . 

The evaluators recommend that a review of process K-3.8P occur, 
emphasizing a consideration of the frequency and appropriateness 
of the actual process activities. 
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Objective K-3 . 9 : 



Given a set of objects containing items of dif- 
ferent sizes or shapes or weight, 100% of the 
children will be able to differentiate the sizes 
and shapes and weights. This will be measured by 
teacher rating and observer checklists. 

Evaluation: 

The children were presented with a series of objects which 
were each weighed on the scale; then the child was asked to 
identify the heaviest object. The highest possible score a 
child could receive was five correct; this score was required 
for the child to satisfy the objective. The results of a t-test 
for correlated data comparing the pre- and post-test scores are 
summarized in Table 66. 

Table 66 notes that 44% of the children received a satis- 
factory score on the pre-test, while 100% of the children received 
an appropriate score on the post^test. Objective K-3. 9 was accom- 
plished. Similarly, a significant difference existed between the 
pre-test and post-test scores; such a difference could have occur- 
red by. chance less than one time in 1,000. These results suggest 
that objective K-3. 9 is appropriate for the kindergarten group 
and for the kindergarten program of instruction. The expected 

t 

criterion level of 100% also seems to be appropriate. The eval- 
uator recommends that this objective be included in its present 
form as part of the instructional program for the next program 
year . 
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Table 66 



instructional Objective K-3.9 
N, X, SD, % at Criterion and t-ratio 



A: 

K' 



( ■ 
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N= 24 





Pre 


Post 


X 


3.9166 


4.9166 


SD 


1.3203 


0.4000 


% at Criterion 


44 


100 



Difference 
. Between Means 
df 
t 



1.0000 

23 

4.0338* 



* <.001 



Objective K-3.9P : 



The classroom teacher will evaluate each child 
individually at the beginning, of the year and 
group children for instruction. Teachers will 
provide appropriate exercises and opportunities 
to perform at least once a week. These acti- 
vities will be recorded in the lesson plan book. 



Evaluation : 



At the beginning of the year children were individually 
tested on their ability to discriminate objects according to 
Weight and shape. Children were then grouped for instruction. 
Appropriate exercises were provided at least once a week for 
the following percentage of time: 
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December - 50% 

January - 77% 

February - 61% 

March - 75% 

April - 76% 

May - 51% 

These percentages indicate that, for the most part, acti- 
vities were performed at one-half of the anticipated frequency. 

The fact that objective K-3.9 was accomplished and that a sig- 
nificant difference existed between the pre-test and post-test 
scores for that objective suggests that the procedures and fre- 
quency of use of these procedures for accomplishing those objec- 
tives were appropriate. 



Objective K-3.10 ; 



Given a pictorial representation of a clock, 
80% of the children will be able to state 
orally the correct time ot the hour. Their 
skills will be measured by teacher rating and 
observer checklists. 



Evaluation: 



The students were presented with a demonstration clock. 

The teachers fixed the hands at a certain hour time. The child 
was then asked to identify the time correct to the hour. This 
exercise was repeated with five different times; therefore, the 
highest score was five. The students were required to answer 
all questions correctly to accomplish the objective. 

Table 67 notes that on the pre-test 16% of the participants 
could identify the correct time to the hour , and on the post-tost 
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Table 67 




Instructional Objective K-3.10 
N, X, SD, % at Criterion and t-ratio 



N= 24 





Pre 


Post 


X 


1.9583 


4.5000 


SD 


1.8591 


1.0000 


% at 


Criterion 67 


76 




Difference 
Between Means 


2.5417 




df 


23 




t 


7.2454* 



* <.001 

76% of the participants could do this activity. This percen- 
tage was not sufficient for the achievement of the objective. 

It seems possible that the required percentage of 80% was not 
appropriate, as a significant difference existed between the pre 
test and post-test scores as shown in the t-test for correlated 
data summarized in Table 67 . A difference this large could have 
occurred by chance less than one time in 1,000. The evaluators 
suggest that the project staff review the criterion level 
specified in objective K-3.10 and determine if it is appro- 
priate or too high. Objective K-3.10 was not accomplished, 
although some form of it does seem to be an appropriate 
objective for inclusion in the kindergarten component. A 
significant gain in the ability to identify time occurred. 

155 

152 



Objective K-3.10P ; 



The classroom teacher will evaluate each child 
individually at the beginning o£ the year and 
group children for instruction. Teachers will 
provide appropriate exercises and opportunities 
to perform it at least once a week. These acti- 
vities will be recorded in the lesson plan book. 



Evaluation : 
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The testing of children and grouping for instruction as 

specified in objective K-3.10P occurred at the beginning of 

the school year. This process was observed by the evaluator 

during on-site visits and in interviews with the teachers. 

Appropriate exercises and opportunities to perform the process 

for this objective were provided at least once a week for the 

following percent of time: 

December - 0% 

January - 15% 

February - 30% 

March - 20% 

April - 30% 

May - 7% ^ 

These percentages are quite low as compared to the 100% 
performance which should have occurred. The fact that the 
criterion level was not accomplished, but that a significant 
difference existed between the pre-test and post-test scores, 

. suggests that the procedures used were appropriate, but that 
they were not performed with satisfactory frequency; this con- 
clusion is confirmed by the percentages cited above. The eval- 
uators recommend that an attempt be made to perform the processes 
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specified for objective K-3.10P with the frequency required , at 
least once a week, rather than with the frequency that they 
were performed during this school year less than one-fifth of 
the specified time. This emphasis should contribute to the 
accomplishment of the objective K-3.10. 






Objective K-3.11 : 

Given a set of coins containing pennies , dimes , 
and nickels, 90% of the children will be able 
to identify orally each coin by name. This will 
be measured by teacher and observer checklist. 

Evaluation ; 

The student was tested on this objective by being shovin a 
penny, a dime, and a nickel and required to orally identify the 
name of each coin. The highest possible score a student could 

■; 

receive was three correct; this score was required to accomplish j 

objective K-3.11. A t-test for correlated data was used to com- 
pare the pre-test and post-test scores, as summarized in Table 68. 

' i 

I 

Table 68 indicates that 19% of the class satisfied this objec- J 

tive on the pre-test, and 85% satisfied it on the post-test. j 

However, this percentage of the class was not sufficient for the .j 

program to accomplish the objective . It should be noted that a 
significant difference existed between the pre-test and post-test 
scores at the .001 level. These results imply that this objective 

was appropriate for the kindergarten children and some progress 

• •• • ' • ■ ’ > 

toward its accomplishment was made. A review of the process { 
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Table 68 



Instructional Objective K-3.11 
N, X, SD, % at Criterion and t-ratio 



N= 21 






Pre post 


X 




1.2380 2.7619 


SD 




1.2380 0.6097 


% at 


Criterion 


19 85 




Difference 






Between Means 


1.5239 




df 


20 




t 


6.7819* 



* <.001 



directed toward this objective may indicate why more of the stu- 
dents did not accomplish the objective. 

Objective K-3 .3 IP i 



l 



\ 

I 

i 
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The classroom teacher will evaluate each child 
individually at the beginning of the year and 
group children for instruction. Teachers will 
provide appropriate exercises and opportunities 
to perform at least once a week. These activi- 
ties will be recorded in the lesson plan book. 



Evaluation: 



Evaluation of student abilities was undertaken at the begin 
ning of the year on an individual basis. Students were then 
grouped for instruction. The following percentages indicate 
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what part of the time appropriate activities were provided at 
least once a week: 

December - 46% 

January - 33% 

February - 38% 

March - 50% 

April - 30% 

May - 15% 

The fact that none of these percentages approached 100% 
suggests that processes directed toward product objective K-3.11 
were not being performed with satisfactory frequency. The fact 
that the criterion level specified in the objective was not 
accomplished further supports this conclusion. The significant 
difference between pre-test and post-test scores on the product 
objective suggests that the activities being performed for pro- 
cess K-3.11P were appropriate, but were just not occurring with 
sufficient frequency. The evaluators recommend that if product 
objective K-3.11 is included in 1971-72 project an attempt 
should be made to structure activities on a more frequent basis. 



Objective K-4.l t 



The student will demonstrate a comfortableness 
with French in the classroom as demonstrated by 
50% of the class showing willingness to partici 
pate at least once in class discussion. This 
will be recorded by observer checklists. 



Evaluation : 



In order to determine the comfortableness with French of the 
students in the classroom the teacher organized a discussion in 
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French about the topic "The Family" and asked a series of six 
questions related to this topic. The teacher recorded for each 
child if he talked in French at any time during the conversation. 
The child, therefore, received either a positive score or a nega- 
tive score; a sign test for correlated data was used to compare 
the pre and post scores, as summarized in Table 69. 

Table 69 

Instructional Objective K-4.1 
Summary of Sign Test for Correlated 
Data and Percent at Criterion Level 



Number with Pre and Post Scores 
Number Showing Positive Change 
Number Showing Negative Change 
z 
P 



21 

5 

0 

1.7889 

not significant 



% at Criterion-Pre 57 

% at Criterion-Post 80 



Table 69 indicates that 57% of the students participated in 
the French conversation on the pre-test, and 80% participated dur- 
ing the post-test. Both pre- and post-test percentages were 
greater than that required by the objective. The evaluators 
recommend that the program staff review the appropriateness of 
the criterion level of this objective because it was accomplished 
at both testings. No significant difference existed between the 
pre-test and post-test scores. Objective K-4.1 was accomplished. 



160 




157 



Objective K-4 .IP : 

The teacher will provide daily opportunity 
for discussion in French. The teacher will 
not discourage the children's use of their 
patois French. Activites will be recorded 
in their lesson plan book. 



Evaluation: 



Daily opportunities for discussion in French were provided 
with the following frequency: 



The percentages represent the percentage of weeks in all the 
classrooms in which opportunity for discussion in French was pro- 
vided. Because of the nature of the program, the lack of such a 
discussion 100% of the time suggests a possible reason for the 
failure of the program to accomplish objective K-4.1. Because 
this program is a bilingual program, the evaluators recommend 
that the teachers be encouraged to provide daily opportunity for 
discussion in French. This should be a procedure which is more 
strictly structured and enforced by the project administration. 
The fact that no French specialist exists in the program at this 
time may be an explanation for the lack of encouragement and 
structuring of daily discussion in French. The evaluators recom- 
mend that a consideration be made of including such a program in 
next year's project. 



December - 
January - 
February - 
March 



84% 



April 

May 



- 66 % 

- 52% 

- 100 % 

- 69% 

- 91% 
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Objective K-4.2 : 

Students will demonstrate standard expression 
and pronounciation. At the end of the year the 
teacher will ask questions with standard response 
patterns as measured by teacher ratings and obser- 
ver checklists. 

Evaluations 

This objective was assessed by the teacher's presenting a 
brief conversation in French to a small group of French speaking 
students. The last sentence of this conversation asked the 
students a question. They were then encouraged to respond 
to the question; their ability to respond with standard French 
expressions and pronounciation was noted. The pre-test and 
post-test ratings, yes or no, were compared with a sign test 
for correlated data which is summarized in Table 70. 

Table 70 indicates that 47% of the students contributed 
orally in standard French during the pre-test conversation, and 
only a slightly larger percentage, 52%, contributed in standard 
French to the post-test conversation. These results suggest 
that the instructional activities organized in the classroom 
which were directed toward this objective were not appropriate 
for the accomplishment of this product objective. A review of 
the corresponding process objective may indicate if either of 
these two conditions exist. . Objective K-4.2 was not accomplished. 
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Table 70 



Instructional Objective K-4.2 
Summary of Sign Test for Correlated 
Data and Percent at Criterion Level 



Number with Pre and Post Scores 17 

Number Showing Positive Change 2 

Number Showing Negative Change 1 

2 0 . 0000 
p not significant 



% at Criterion-Pre 47 

% at Criterion-Post 52 



Objective K-4.2P : 



The audio— lingual method of presentation will be 
used. At the beginning of the year the teacher 
will administer orally to a sampling of the class 
questions wich elicit non-standard response pat- 
terns. Drill will be provided to the class as a 
group using full choral , half choral and individ- 
ual response patterns. Children needing additional 
drill will utilize the language master, using 
response cards prepared by the project director. 

The activities will be recorded in the lesson plan 
book. 



Evaluation : 

The audio-lingual method of presentation was used in the 
classrooms. At the beginning of the year the teachers adminis 
tered questions which elicited a non-standard response pattern 
They also used drills involving full choral, half choral and 
individual response pattern. Children who required additional 
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drills utilized the Par Ions Francais Kit or teacher-made lan- 



guage master cards. Confirmation of the existence of this 
process activity was based on on-site observation of classes 
and interviews with classroom teachers. Teachers performed 
these activities at least once a week for the following per- 
centage of weeks: 

December - No record of process exists. 

January - No record of process exists. 

February - 68% 

March - 50% 

April - 84% 

May - 65% 

It should be noted that process objective K-4.2P does not 
specify how frequently such drills should occur. However , it 
seems obvious from the failure of students to accomplish objective 
K-4 . 2 , the lack of significant difference between pre- and post- 
scores, and from the low frequency of performance of objective 
K-4.2P, that additional structuring of objective K-4.2P should 
occur. The evaluators recommend that the project focus on deter- 
mining appropriate processes and frequencies of these processes 
for accomplishing objective K-4. 2. 

Obj ective K-4 . 3 : 

Students will show a statistically significant 
(p .05) improvement in French vocabulary recog- 
nition as measured by a French vocabulary test 
(either standardized or teacher-made) . 

Evaluation: 



Students were tested on this objective by being shown a 
series of 21 cards; each pictured a representation of a French 
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vocabulary word; the child was asked to name the object in 
French. The highest possible score a student could receive 
was 21 correct. 

Table 71 

Instructional Objective K-4.3 
N, X, SD, % at Criterion and t-ratio 



N= 15 





Pre 


Post . 


X 

SD 
% at 


7.4000 

4.8138 

Criterion 0 


9.2000 

4.6647 

0 




Difference 
Between Means 


1.8000 



df 14 

t 2.8731* 



* <.05 

Table 71 indicates the results of the t-test for correlated 
data. The post-test scores were significantly different from the 
pre-test scores at the .05 level with the mean post— test score 
higher than the mean pre-test score. Therefore, objective K-4.3 
was accomplished. 

Objective K-4.3P : 

Vocabulary will be introduced within the frame- 
work of classroom activity. The classroom teacher 
will prepare for each new vocabulary word a visual 
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representation card. Peer teaching will be used 
for drill followed by utilization of the language 
master for students needing additional drill. The 
activities will be recorded in the lesson plan 
book. 



Evaluation : 



Vocabulary was introduced within the framework of class- 
room activites. Teachers prepared and used visual representation 
cards for new vocabulary words. They also used language master 
cards from the Parlons Francais Kit and the Talking Dictionary 
Kif for those students who required additional drill. Although 
process objective K-4.3P does not specify the frequency with 
which such drills should be performed, the following percentages 
indicate that amount of time in which the activities were per- 
formed at least once a week: 

December - No record of process exists 

January - No record of process exists 

February - 84% 

March - 65% 

April - 92% 

May - 71% 

Since product objective K-4.3 was accomplished it seems 
reasonable to conclude that these percentages are appropriate 
frequencies for teaching of the process objectives. The eval- 
uators recommend that a review of the frequency and processes 
used for the teaching of objective K-4.3 be made, and that a 
more specific statement of the specific frequency required be 
included in the process objective. 
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Objective K-4 . 4 ; 



Students will demonstrate their ability to read 
basic French words with a standard accent. The 
teacher will provide a picture of ten basic 
French words. 85% of the class will be able to 
produce with standard accent the sound for eight 
of the words. This will be measured by teacher 
ratings and observer checklists. 



Evaluation : 



The teacher presented each child with a series of ten pic 
t ur es correctly in French with a standard accent. 



Table 72 

^Instructional Objective K-4. 4 
N, X, SD, % at Criterion and t-ratio 



N= 18 



c 

*'); 

r. 

s 

*► 

i ■ 1 


X 
SD 
% at 


Pre 

5.4444 

1.6063 

Criterion 0 


Post 

7.6111 

2.0953 

0 


f • 




Difference 




N-‘ 




Between Means 


2.1667 


*:■; • 




df 


17 


E 




t 


3.5730* 



* <.01 

results of the t— test for correlated data used to analyze 
the scores satisfied the criterion on the pre-test, and no stu- 
dent satisfied the criterion on the post-test. It should be 
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noted , however, that a significant difference existed between 
the pre-test and post-test results. These finding suggest that 
the project staff should review the appropriateness of the cri- 
terion established in the objective, that of 85% of the class 
being required to pronounce eight of ten sounds with a standard 
accent. After a consideration of the appropriateness of the 
criterion a revision of the objective seems reasonable. The 
fact that a significant difference exists between the pre and 
post test scores, however, suggests that the program is making 
some impact on the students' French pronounciation skills. 
Objective K-4.4 was not accomplished. 



Objective K-4 .4P : 



The teacher will introduce the students to the 
phonetic sounds of the consonants and basic 
vowel sounds (Dolch List) . Words will be con- 
structed from these sounds by the classroom 
teacher and placed on flash cards. Peer teach- 
ing will be used for drill. Activities will 
be recorded in the lesson plan book. 



Evaluation : 



The majority of teachers did not perform this process be- 
cause they did not think the students were ready to read French 
words during the program. The following percentages, however, 
indicate the frequency with which teachers performed the acti- 
vity at least once a week; no classroom began to perform this 
activity until March: March - 25%, April - 23%, May - 7%. The 

lack of emphasis on this process objective indicates quite 



165 168 



i 

b 

i 



ERIC 



clearly the reason why objective K-4.4 and K-4.4P was not accom- 
pliahed . The evaluators recommend that the project revevTboth 
the product and process objectives K-4.4 and K-4.4P to deter- 
mine whether they cure appropriate for the program. If they 
are not appropriate they should be eliminated from instruc- 
tional procedures. 

Objective K-5 . 1 : 

50% of the monolingual English students will 
show comprehension of simple classroom commands 
and procedures presented orally in French by 
the teacher by their ability to perform those 
commands. This will be measured by teacher 
rating and observer checklist. 

Evaluation ; 

The English students selected for measurement of this 
objective were tested by the following procedures: the aide or 

teacher gave them a series of four commands in French to which 
they responded by performing the appropriate action; therefore f 
the highest possible score on this test was four • Students were 
only post— tested. The mean post— test score was 2.25. 25% of 

the students scored four correct as required by the objective. 
Objective K-5.1 was not accomplished; reasons for this failure 
should be investigated by the project staff and appropriate 
changes implemented. 
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Objective K-5.1P : 



An audio-lingual approach will be used, coupled 
with the use of pattern drills programmed on 
cassettes and the language master . Activities 
will be carre id out daily and recorded in the 
lesson plan book. 



Evaluation : 



Classroom observation of kindergarten classes indicated that 
the teachers were using an audio-lingual approach to teaching 
French. They were also using pattern drills which were program- 
med on cassettes and on language masters. The process specified 
that teachers would provide appropriate activities daily. Daily 
activites were provided for the following percentage of time: 

December - 50% 

January - 30% 

February - 76% 

March - 75% 

April - 84% 

May - 71% 

A review of these frequencies indicates that the percen- 
tages did not approach the 100% required by the objective. 
Because the product objective which corresponds to this pro- 
cess objective was not accomplished, this suggests that the 
process should have been performed more frequently. The 
evaluators recommend that a greater structuring of this pro- 
cess occur and that closer monitoring of its performance be 
made during the next project, year. 
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Objective K-5 . 2 s 



75% of the English speaking students will be 
able to sing at least three French songs and 
play three French games. This will be mea- 
sured by teacher rating and observer checklist. 



Evaluation ; 

This objective was measured by instructing the group of 
children to sing three songs and play three games learned during 
the year. The teacher then observed if each child in the group 
was singing and/or playing the game. Those students who did so 
without hesitation received credit for their performance on the 
checklist. The highest possible score a student could receive 
on this measure was six. All three students tested received a 
score of six; therefore# 100% of the students accomplished the 
objectives stated for K-5. 2. No pre-test measure of this objec- 
tive had been made. Objective K-5. 2 was accomplished. 

Objective K-5.2P : 

i 

Songs and games to be used will be collected by 
teachers during the summer. They will practice 
this activity at least once a week and record 
it in their lesson plan book. 

Evaluation t 

Because of the late start of the program songs and games 
were no t collected during the summer, but during the fall potato 
harvest vacation. Teachers practiced the process of using songs 
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and games in the classroom at least once a week for the follow- 
ing percentage of time: 



December - 83% 

January - 92% 

February - 100% 

March - 90% 

April - 92% 

May - 78% ? 

This high frequency of occurrence of the process activity 
probably explains the reason for the accomplishment of product 
objective K-5.2. The evaluators recommend that this process be 
continued during the next program year. 



Objective K-5 . 3 : 



75% of the English speaking children will be able 
to identify orally 75% of the words on the French 
vocabulary lists developed by teachers. Their 
abilities will be measured by observer checklists 
and teacher ratings. 



Evaluation : 



Objective K— 5.3 was measured by the teachers' showing the 
children a series of pictures and pointing to the object that a 
French word depicts. The child was asked to name this word. If 
he pronounced the word correctly in French he received credit for 
the question. The students were asked ten such questions each. 
The mean score on this test was six correct. No student satis- 
fi®^ the criteria of answering eight of ten questions correctly. 
The evaluators recommend that a review of the vacabulary words 
used for this activity be made. Then a review of the process 
used to teach these vocabulary words should also be performed 
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to determine whether congruence exists between the words tested 
and the words taught. Objective K-5.3 was not accomplished. 



Objective K-5.3P : 



Vocabulary will be introduced within the frame- 
work of classroom activities. The classroom 
teacher will prepare for each new vocabulary word 
a visual representation card. Peer teaching will 
be used for drill followed by utilization of the 
language master for students needing additional 
drill. The activities will be recorded in the 
lesson plan book. 



Evaluation : 



The teachers introduced vocabulary within the framework of 
classroom activities. Visual representation cards for new vocab- 
ulary words were prepared and language master cards from the 
Parlons Francais Kit were used for students needing additional 
drill. This activity was performed at least three times a 
week for the following percentage of time: 

December - No record of process exists 

January - No record of process exists 

February - 46% 

March - 40% 

April - 61% 

May - 60% 

A review of these percentages suggest that no emphasis was 
placed on this activity directed toward product K-5.3 until 
February of the school year. This late implementation of this 
process may suggest, that the criterion level established in 
the objective is too high for the students to obtain during 
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the span of time spent on the activity, or that processes should 
be directed toward its accomplishment earlier in the year. The 
evaluators recommend that the project staff review both the 
process and product for objective K-5.3 and K-5.3P to determine 
their appropriateness, if the objectives are determined to be 
appropriate the teachers should consider an earlier introduction 
of material specified in that objective. 

Objective K-6.1 ; 

75% of the English speaking students will be 
able to sing at least three French songs and 
play three French games. This will be mea- 
sured by teacher rating and observer check- 
lists. 

Evaluation ; 

This objective was measured by the same' test as that used 
to assess objective K-5.2 (refer to evaluation of K-5.2). The 
two students tested on objective K-6.1 both received a perfect 
score of six required by the objective. Therefore, objective 
K-6.1 was accomplished. 

Objective K-6 . IP : 

Songs and games to be used will be collected 
by teachers during the summer. They will 
practice this activity at least once a week 
and record it in their lesson plan book. 
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Evaluation : 



Because of the late start of the program songs and games 
were not collected during the summer but during the fall potato 
harvest vacation. Teachers practiced the process of using songs 
and games in the classroom at least once a week for the follow- 
ing percentage of time: 

December - 83% 

January - 84% 

February - 84% 

March - 80% 

April - 92% 

May - 78% 

This high frequency of occurrence of the process activity 
probably explains the reason for the accomplishment of product 
objective K-5.2. The evaluators recommend that this process be 
continued during the next program year. 







Objective K-6 . 2 : 

50% of the children will be able to tell orally a 
story about a historical event or person related 
to the Valley's history. This will be recorded 
and checked by teacher and evaluator on a check- 
list. 

Evaluation : 

The teacher presented each child individually with a booklet 
entitled "Les Acadiens" and asked the child to tell the teacher 
a story by reading the pictures. If the child could read ten 
of eighteen pictures correctly he would have satisfied the 
objective of telling about a historical event. Sixty-seven 
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percent of the students received a satisfactory score of ten on 
this test. The mean score on the post-test for the six students 
tested was 10.13. No pre-test was administered. Objective 
K-6.2 was accomplished. 

Objective K-6.2P ; 

Appropriate stories about people and events in 
Valley history will be collected by teachers and 
used in the classroom on dates that are on or 
near significant dates for the even or person. 

Evaluation : 

Process K-6.2P was performed by the teachers. The booklet 
called "Les Acadians" was published by the project, it included 
appropriate stories about people and events in Valley history. 

Teachers performed process activities considered under objective 
K “6*2P at least once a week for the following percentage of time: 

March ~ 5%, April - 15%, May - 17%; it should be noted that the 
process was first performed in March. Since objective K-6.2 was 
accomplished, this seems to be a satisfactory frequency for the 
process even though it was not as high as planned. 

Objective K-6.3 : 

50% of the students will be able to identify 
from a picture at least three l andmar ks of 
the Valley area. This will be measured by 
teacher rating and observer checklist. 
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the appropriateness of objective K-6.3 for inclusion in the 
bilingual program. A decision should be made as to whether 
kindargarten instruction will focus on this aspect of cultural 
teaching. Objective K-6.3 was not accomplished. 

Objective K-6.3P : 



Teachers will collect pictures of Valley land- 
marks (e.g. buildings ox* significant natural 
resources) and describe them to the children 
and their importance . The activities will be 
recorded in the lesson plan book. 



Evaluation : 



This process was not performed by the teachers. This 
explains why the corresponding product objective was not 
accomplished. The evaluators recommend that the project 
review both product and process to determine if they are 
appropriate for inclusion in the kindergarten instructional 
program. 
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INSTRUCTIONAL COMPONENT: GRADE ONE OBJECTIVES 



Objective 1-1.1 : 



100% of the students will demonstrate the 
readiness skills specified for K. Refer 
to instructional K component for specific 
performance objectives and evaluations. 



Evaluation : 



The fact that the grade one students were promoted from 
kindergarten to first grade suggests that they have demonstrated 
the readiness skills specified for kindergarten. In this sense 
Objective 1-1.1 has been accomplished. 



Objective 1-1 .P : 



The teacher will continue development of all 
readiness skills. Teachers will evaluate 
children at the beginning of the year to deter- 
mine their mastery of the readiness skills. 
Instruction will be provided on an individ- 
ualized small group basis. Children will be 
identified and activities provided for them 
record ed in the lesson plan book. 



Evaluation : 

No evaluation of the process objective occurred. It was 
assumed that since the children were learning first grade curri- 
culum they already possessed the readiness skills needed for this 
instruction. Any readiness skills still required were provided 
by the first grade teacher. 
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Ob j ective 1-1.2 ; 

At the conclusion of the year 40% of the stu- 
dents will correctly say in English the 115 
words common to pre-primers when presented a 
visual stimulation. Their abilities will be 
measured by teacher ratings and observer 
checklists. 

Evaluation : 

This objective was measured by showing each individual a' 
series of pictures . The students were asked to identify the 
picture using a single word to name it. The student's reply had 
to match that word written on the back of the picture to receive 
credit. The highest possible score on this exercise was twelve 
correct. A t-test for correlated data was used to compare the 
pre-test and post-test scores; this analysis is summarized in 
Table 74. 

The results in Table 74 state that 12% of the students had 
attained the criterion level on the pre-test, and 15% of the 
students had attained it on the post-test. This percentage was 
not sufficient for the accomplishment of objective 1-1.2. It 
should be noted, however, that a statistically significant dif- 
ference existed between the pre-test and post-test scores. 

These results suggest that the established criterion level 
may not be appropriate for these students. The evaluators 
recommend that the project staff review the appropriateness 
of this objective and reconsider the criterion level of 40% 
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established in the objective. Objective 1-1.2 was not accom 
plished. 



Table 74 

instructional Objective 1-1.2 
N, X, SD, % at Criterion and t-ratio 



N= 23 





Pre 


Post 


X 


9.3478 


10.3043 


3D 


1.5211 


1.1587 


% at Criterion 


12 


15 



Difference 

Between Means 0.9565 

df 22 

t 3.5412* 



* <.01 



Objective 1-1. 2P : 



Teachers will diagnose the learning styles of 
children and will use a phonetic or whole word 
approach for different children. Activities 
will be provided at least once a week and will 
be recorded in the lesson plan book. 
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Evaluation : 

Interviews with teachers and classroom observation of 
grade one classes indicated the teacher diagnosed the learning 

styles of children. They then used the phonetic or whole 

/ 



181 



A 




178 



word approach for different children depending on their par- 
ticular needs. Activities which the teachers used were moni- 
tored by the evaluator and curriculum coordinator. Activities 
directed toward the performance of project objective 1-1.2 
was provided at least once a week for the following percentage 
of time: 



December - 62% 

January - 76% 

February - 100% 

March - 95% 

April - 90% 

May - 79% 

In spite of the fact that process objective 1-1. 2P was 
performed with high frequency, the corresponding product objec- 
tive was not accomplished. This observation suggests that the 
activities specified in this process may not have been appro- 
priate for instruction or once a week was not sufficient 
frequency for performance of the activities. The evaluators 
recommend that the project staff review the appropriateness 
of process activities 1-1. 2P and determine if they are occur- 
ring with satisfactory frequency; appropriate changes should 

then be implemented./ 

/ 

f 
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Objective 1-1.3 : 



At the conclusion of the year 40% of the stu- 
dents will, when presented a word with the 
following initial consonants followed by a 
known ending, correctly state the word: b,d, 
f ,h, j,k,l,m,n,p,q,r,s,t,v,w,x,y,z. Their 
skills will be measured by teacher ratings 
and observer checklists. * 
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Evaluation : 

The results of the t-test for correlated data shown 
in Table 75 describe the students' performance of objective 

1-1.3. The students were presented with a word card and 

) ' ; 

instructed to read the word on the card. The tester recorded 

the student's progress on the checklist for this objective, 
which was composed only of the initial letter of each word. 

If the student read the word correctly he was given credit 
for appropriately identifying its initial letter. The 
highest possible score a student could receive was eighteen 
correct . 

Table 75 

Instructional Objective 1-1.3 
N, X, SD, % at Criterion and t-ratio 



N» 19 





Pre 


Post 


X 


2.5263 


12.6315 


SD 


3.2014 


6.3925 


% at Criterion 


0 


27 



Difference 
Between Means 
df 
t 



10.1052 

18 

7.8566* 



* <.001 
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The results in Table 75 indicate that no student performed 
at the criterion level on the pre-test, and 27% of the students 
performed at the criterion level on the post-test. Twenty- 
seven percent, however, was not the 40% required by the objective 
It seems quite possible that since a significant difference 
occurred between the pre-test and post-test scorns at the .001 
level that the performance level of 100% correct established for 
these students may have been too high. The evaluators recommend 
that the project review the appropriateness of the criterion 
level specified in objective 1-1.3. Objective 1-1.3 was not 
accomplished . 

Objective 1-1 .3P : 

Teachers will use a phonetic approach to teach- 
ing these word skills. They will provide appro- 
priate exercises and opportunities to perform 
at least once a week. These activities will be 
recorded in the lesson plan book. 

Evaluation : 

Classroom observation and discussion with grade one tea- 
chers indicated that they used the phonetic approach to teach 
these words skills. Teachers provided appropriate exercises to 
perform activities directed toward objective 1-1.3 at least once 
a week for the following percentage of the time: 



December - 93% 
January - 100% 
February - 100% 



March 

April 

May 



95% 

100 % 

79% 
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The fact that the teachers were performing what their con- 
sidered to be appropriate activities once a week, suggests that 
either once a week was too infrequent for these activities, or 
that the actual activities were not appropriate for achieving 
objective 1-1.3. The evaluators recommend that the project 
staff review the appropriateness of the processes used for the 
attainment of objective 1-1.3, and also consider increasing the 
frequency with which they are performed. 

Objective 1-1.4 ; 

At the conclusion of the year 40% of the stu- 
dents will correctly name words in which the 
following consonants occur in the final posi- 
tion: c,d,f ,h, j ,k,l ,m,n,p,q,r ,s,t,v,w,x,y.z. 

Their skills will be measured by teacher rat- 
ing and observer checklists. 

r 

Evaluation : 

This objective was tested by showing the child a series 
of seventeen cards, each with three pictures on it. The child 
was asked to name the picture which ended with a particular 
sound. The highest possible score a student could receive was 

4 

seventeen correct. 

The results shown in Table 76 indicate that on the pre- 
test 28% of the students accomplished the objective, while 
no student accomplished it on .the post-test . It should be 

) 
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noted, however, that a significant difference existed between 
the pre-test and post-test scores, as shown by the t-test for 
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Table 76 



Instructional Objective 1-1.4 
N, X, SD, % at Criterion and t-ratio 



N= 18 



Pre 



Post 



X 

SD 

% at Criterion 



11.0555 

5.2225 

28 



15.1111 

3.6649 

0 



Difference 
Between Means 



4.0556 

17 

3.6445* 



df 

t 



* <.01 



correlated data summarized in Table 76. These results suggest 
that the students improved but that those students who had 
received perfect scores on the pre-test received lower scores 
on the post-test. The evaluators recommend that the project 
staff review the appropriateness of this objective. The fact 
that a significant gain occurred suggests that the bilingual 
program had some impact on the achievement of this objective, 
but not a sufficient impact to accomplish the objective. 
Objective 1-1.4 was not accomplished. 

Objective 1-1 ,4P : 



Teachers will use a phonetic approach to teach- 
ing these word skills. They will provide 
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appropriate exercises and opportunities in the 
lesson plan book. 

Evaluation ; 

Teachers provided a phonetic approach £or teaching word 
skills. This was confirmed by discussion with the teachers 
and on-site visits. The teachers provided appropriate exer- 
cises for accomplishing objective 1-1.4 at least once a week 
for the following percentage of time; 

December - 93% 

January - 100% 

February - 100% 

March - 91% 

April - 95% 

May - 77% 

These high frequencies suggest that if the process was 
appropriate as specified these student should have accom- 
plished the objective 1-1.4; but because objective 1-1.4 
was not accomplished, it seems, reasonable to conclude that 
either the process activities which were directed toward 
this objective were not appropriate or the frequency of per- 
forming them once a week was not sufficient. The evaluators 
recommend that a review of process 1—1. 4P be made, with con- 
sideration for its appropriateness and that of the frequency 
with which it is performed. 

Objective 1-1.5 ; 

At the conclusion of the year 40% of the stu- 
dents will correctly name words in which the 
consonant sounds occur in the middle of the 
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word. Their abilities will be measured by 
teacher rating and observer checklist. 



Evaluation ; 

This objective was assessed by presenting each child with 
a series of cards, each containing three pictures. The tester 
instructed the student to name the picture which had a partic- 
ular sound in the middle. This exercise was repeated for eighteen 
questions; the students were required to answer all eighteen 
questions correctly to accomplish the objective. The t-test for 
correlated data used to compare the pre-test scores is summa- 
rized in Table 77. 



Table 77 

Instructional Objective 1-1.5 
N, X, SD, % at Criterion and t-ratio 



N= 17 






Pre 


Post 


X 
SD 
% at 


Criterion 


9.7058 

5.4640 

17 


14.5882 

3.8204 

0 




Difference 
Between Means 
df 
t 


4.8824 

16 

3.9778* 



* <.01 
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The results shown in Table 77 state that 17% of the stu- 
dents could perform the specified activity on the pre-test, and 
no student could perform the specified activity on the post-test. 
Yet a statistically significant difference exists between the 
pre-test and post-test scores. This suggests that, although 
17% of the students received perfect scores on the pre-test, 
the majority of students improved their scores from the pre- to 
the post-test. The results for this objective suggest that the 
program staff should review the appropriateness of the criterion 
level and performance level specified in the objective. The 
evaluators recommend a review of this objective before its in- 
clusion in the next project's insturcitonal program. Objective 
1-1.5 was not accomplished. 

Objective 1-1 .5P ; 



Teachers will use a phonetic approach to teach- 
ing these word skills. They will provide 
appropriate exercises and opportunities to per- 
form at least once a week. These activities 
will be recorded in the lesson plan book. 



r<: 

r 



o 

ERIC 



■ w 



Evaluation : 

Monitoring of classroom activities indicated that the 
teachers employed a phonetic approach in teaching word skills. 
They provided appropriate activities for acquiring skills 
stated in objective 1-1.5 at least once a week for the fol- 
lowing percentage of time: 
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December - 56% 

January - 94% 

February - 81% 

March - 86% 

April - 95% 

May - 70% 

For the most. part, these frequencies were quite high, 
although they did not approach 100%. Since the corresponding; 
product objective was not accomplished, either 100% perfor- 
mance of the process at least once a week must occur, or a 
review of the appropriateness of the process as specified 
should be made. The exercises provided may not have been 
appropriate for accomplishing the objective, or once a week 
was not a sufficient frequency for presenting these exercises. 
The evaluators recommend a review of this objective before 
its inclusion in the 1971 program. 

Objective 1-1,6 ; 



At the conclusion of the year 20% of the stu- 
dents will correctly pronounce words using the 
following initial consonant blends; sh,st,bl,tr, 
fr ,wh,th,ch ,sl ,cl,gl ,sp,sm,sn,sw,tw. Their 
abilities will be measured by teacher ratings 
and observer checklists. 

Evaluation : 

The results of the t-test for correlated data between 
the two sets of scores shown in Table 78 indicate that no 
student could perform the objective at the specified level 
on either the pre-test or post-test. In addition, no sig- 
nificant difference in their ability to correctly pronounce 
o 
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Table 78 



instructional .Objective 1-1.6 
N, X, SD, % at Criterion and t-ratio 





in 

CM 

it 

Z 




Pre 


Post 


X 
SD 
% at 


14.8400 

3.1071 

Criterion 0 


15.9200 

0.2712 

0 




Difference 
Between Means 
df 
t 


1.0800 

24 

1.8009* 



* Not significant 



words using initial consonant blends occurred between the 
two testings. Students were tested by being presented a 
series of pictures. They were required to name the picture; 
correct identification gave them credit for the initial 
blend of the word. 

The evaluators recommend that a review of the appropri- 
ateness of this objective for accomplishment in grade one be 
made. The fact that no student could perform the objective 
at the specified level and that the students made no gain 
between pre- and post-testing questions its appropriateness 
for inclusion in the program. Objective 1-1.6 was not accom- 
plished. 
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Objective 1-1 ,6P; 



Teachers will use a phonetic approach to teach- 
ing word skills. They will provide appropriate 
exercises and opportunities to perform at least 
once a week. These activities will be recorded 
in the lesson plan book. 



Evaluation: 



The teachers used the phonetic approach to teaching word 
skills. This was confirmed by classroom observation of the 
evaluator and curriculum coordinator. Teachers provided appro- 
priate activities for learning initial consonant blend sounds 
at least once a week for the following percentage of time: 

" December - 31% 

January - 76% 

February - 90% 

March - 86% 

April - 100% 

May - 79% 

Because of the generally high frequency of performing the 
activities specified at least once a week , lack of performance 
probably cannot be cited as the reason for the failure of the 
students to accomplish objective 1-1.6. The project staff 
should review the appropriateness of the exercises provided at 
least once a week. They should also consider whether performing 
this activity only once a week is sufficient. A review of 
objective 1-1.6 should occur before it is implemented for the 
next project year. 
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Objective 1-1.7 ; 

At the conclusion of the year, 20% of the stu- 
dents will correctly pronounce words involving 
the three ending sounds of "ed" as in wanted (ed) , 
moved (d) , and liked (t) and the endings "ing" 
and "s" . Their skills will be measured by tea- 
cher ratings and observer checklists. 



Evaluation : 



Objective 1-1.7 was tested by presenting the student a 
word stimulus which he identified with or without the help of 
the teacher. After this word stimulus was presented and iden- 
tified a word with a similar ending sound was presented and 
the student was requested to identify this word. This procedure 
was repeated for five questions. Students were required to 
answer all questions correctly to accomplish the objective. 





Table 79 






Instructional Objective 1- 


-1.7 




N, X, SD, % at Criterion and 

•-SV- 

A 


t-ratio 


N= 27 




Pre 


Post 


X 


0.0000 


2.1851 


SD 


0.0000 


2.0191 


% at 


Criterion 0 


33 




Difference 






Between Means 


2.1851 




df 


26 




t 


1.0822* 



* Not significant 
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The results of the t-test for correlated data and percent- 
age at criterion tabulation summarized in Table 79 indicate 
that no student could perform the objective on the pre-test, 
and 33% of the students could perform the objective on the post- 
test. This 33% of the class is greater than the 20% required 
by the objective. No significant difference existed between 
the pre-test and post-test scores. Objective 1-1.7 was acccm- 
: plished. 

Objective 1-1. 7P ; 



Teachers will use a phonetic approach to teach- 
ing these word skills. They will provide appro- 
priate exercises and opportunities to perform 
at least once a week. These activities will be 
recorded in the lesson plan book. 



' * ■. 
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Evaluation : 

• '.'*•/ ■ V 

Observation of classes and discussion with teachers indi- 
cated that they used the phonetic approach to teaching the 
word skills specified in objective 1-1.7. They provided 
appropriate activites for their students to perform at least 
once a week for the following percentage of time : 

December - 18% 

January - 54% 

February - 54% 

March - 78% 

April - 100% 

May - 75% 

The teachers provided this type of activity with increas- 
ing frequency as the program progressed. This seems to be an 
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appropriate procedure £or teaching the skills in objective 
1-1.7 because the objective was accomplished by the time of 
post-testing. 



Objective 1-1.8 : 
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At the conclusion o£ the year 40% o£ the stu- 
dents will correctly state the pronounciation 
of compound words (into f upon) given a visual 
stimulation. Their abilities will be measured 
by teacher rating and observer checklist. 



Evaluation ; 

Students were requested to pronounce a series of five 
compound words which were represented on a series of picture 
cards. The students received one point for each correctly 
pronounced word. A total score of five correct was required 
for accomplishment of the objective. A t-test for correlated 
data was used to compare the pre-test and post-test score; 
this analysis is summarized in Table 80. Table 80 states 
that 50% of the students accomplished the objective on the 
pre-test and a slightly larger percentage, 55% accomplished 
it on the post-test. 

Both pre- and post-test percentages were greater than 
the criterion specified in the objective. No significant dif- 
ference existed between the pre-test and post-test scores. The 
students' performance on this measure suggests that the pro- 
gram had limited impact on their ability to pronounce compound 
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Table 80 

Instructional Objective 1-1.8 
N, X, SD, % at Criterion and t-ratio 





N= 18 




Pre 


Post 


X 

SD 

% at 


4.2777 

3.4083 

Criterion 50 


4.3888 

4.0354 

55 




Difference 
Between Means 
df 
t 


0.1111 

17 

0.0210* 



* Not Significant 



words. A consideration of the appropriateness of the criterion 
and/or the objective should be made. Objective 1-1.8 was accom- 
| plished. 



Objective 1-1. 8P : 



Sight word drill will be conducted by the 
teacher at least once a week. These will be 
recorded in their lesson plan book. 



Evaluation: 
: 



Sight word drills were conducted by the teachers in order 
to accomplish objective 1-1.8. They were performed at least 
once a week for the following percentage of time : 



i 

193 



1S6 







' * ■ * 



,• • -j.. ,V ; - , ; ; Y : • 






, .,•;••• • / ~ ; v , 






December - 50% 

January - 54% 

February - 100% 

March - 82% 

April - 100% 

May - 71% 

Because no significant difference existed between the pre- 
test and post-test scores/ this frequency of process probably 
reinforced or maintained the skills the students already had 
when they entered the program. The need for such a reinforcing 
activity should be determined. 
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Objective 1-1 . 9 : 

At the conclusion of the year 20% of the stu- 
dents will correctly pronounce words contain- 
ing the following word families: all/ at, it, 

et, en, in, an, ill, ell, ay, ake, or. Their 
skills will be measured by teacher ratings and 
observer checklists . 



Evaluation : 

Objective 1-1.9 was assessed by presenting the student 
with a series of sixty cards, each with a family of words 
printed on it. The student received credit for each word he 
pronounced correctly; the highest possible score was sixty 
correct. Students were required to receive sixty points in 
order to accomplish the objective. A t-test for correlated 
data was used to compare pre— and post-test results, as shown 
in Table 81. 

Table 81 reports that 6% of the students had accomplished 
the objective on the pre-test, while no student could perform 
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Table 81 

Instructional Objective 1-1.9 
N r X, SD, % at Criterion and t-ratio 



N= 18 




Pre 


Post 


X 

SD 
% at 


13.3333 

19.3964 

Criterion 6 


11.2777 

2.7449 

0 




Difference 
Between means 
df 
t 


2.0556 

17 

0.4431* 



* Not Significiant 

the objective on the post-test. In addition, no significant 
difference existed between the pre-test and post-test scores. 
The evaluators highly recommend that a review of this objec- 
tive be made. The appropriateness of this objective for the 
first graders seems highly questionable. The low mean score 
on both pre- and post-tests and the lack of significant dif- 
ference between these two sets of scores suggest that parti- 
cipation in the program had no impact on the acquisition of 
this skill, its importance for inclusion in the progr am 
should be evaluated. Objective 1-1.9 was not accomplished. 
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Objective 1-1 . 9P : 

Sight word drill will be conducted by the teacher 
at least once a week. These will be recorded in 
their lesson plan book. 

Evaluation : 

The sight word drills were conducted by the teacher . Ap- 
propriate exercises were provided at least once a week for the 
students for the following percentage of time: 

December - 81% 

January - 82% 

February - 100% 

March - 82% 

April - 100% 

May - 79% 

These percentages indicate that process 1-1. 9P was being 
performed in the classroom at least once a week for a large 
majority of the time . Yet the corresponding product objective 
was not accomplished. This observation suggests that either 
once a week was too infrequent for the process to result in 
the achievement of the corresponding product objective, or the 
activities included in this process would not lead to the 
achievement of the corresponding product objective. A review 

r 

of these possibilities and restructuring of the process objec- 
tive seems in order. 

Objective 1-1 . 10 : 

At the conclusion of the year 20% of the stu- 
dents will demonstrate 40% accuracy in the fol- 
lowing comprehension skills: 
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Given a printed symbol can verbally describe a 
specific example , eg. shown the words "house" 
the child can describe his or some other house. 

Can follow printed directions, eg. given a pic- 
ture with three objects the child can draw a 
circle around the objects which the directions 
instruct him to circle. 

Can verify a statement (See if Sandy ran away) . 

Can draw conclusions from facts (What do you 
think happened then) . 

Can recall what is being read aloud. 

Can recall what has been read silently. 

Can place events in sequence. 

Can remember where to find answers to questions. 

Their abilities will be measured by teacher rating 
and observer checklist and paper and pencil tests. 

Evaluation: 

Each student was tested on each of the skills specified 
in the objective. For example, the student was shown a re- 
production of the word "house" and askedi to describe a house. 

Similar tests were conducted for the other parts of this 
objective. The highest possible score a student could receive 
was twelve correct; a student was required to receive a score 
of five to accomplish the objective. Table 82 presents the 
summary of the t-test for correlated data used to compare the 
pre- and post-test scores. 

The results shown in Table 82 indicate that 28% of the stu- 
dents received the required score of five on the pre-test, and 
90% of the students received such a score on the post-test. 

Both percentages are sufficient for the accomplishment of 
the objective. A significant difference existed between the 
pre-* £Ost-test scores, a difference tfhich could have 
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Table 82 

^Instructional Objective 1-1.10 
N, X, SD, % at Criterion and t-ratio 



N= 16 



Pre Post 

X 4.1875 10.5625 
SD 4.5307 1.4127 
% at Criterion 28 90 
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Difference 

Between Means 6.3750 

df 15 

t 6.4051* 

* <.001 

occurred by change less than one time in 1*000 • These results 
suggest that the criterion levei established in the objective 
is not appropriate; it seems too low. The evaluators recom- 
mend that this criterion level be changed in line with the 
results obtained from the testing for this objective. Objec- 
tive 1-1.10 was accomplished. 

Objective 1-1 .10P : 



Teachers will follow the techniques outlined in 
the teachers guide for the selected reading ser- 
ies. The activities will be recorded in the 
lesson plan book. 
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Evaluation ; 

Classroom activities indicated that the teachers followed 
the techniques outlines in the teachers guide for the selected 
reading series. They performed activities directed toward these 
comprehension skills at least once a week for the following per- 
centage of time: 



December - No record of process exists 
January - 82% 

February - 100% 

March - 100% 

April - 100% 

May - 78% 



These high percentages of occurrence of process activities 
probably explains the large percentage of students who accom- 
plished the product objective. The significant gain which 



occurred between the pre— and post— testing for the correspond- 
ing product objective suggests that the activities included 



in process 1-1. 10P are appropriate for obtaining the product 
objective. 



Objective 1-1 . 11 ; 
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At the end of the year 10% of the students will 
demonstrate the following oral and silent readincr 
skills: * 

Uses correct phrasing. 

Uses proper voice intonation . 

Understands and follows the signals imparted of 
simple punctuation : such as period , comma , ques- 

tion mark, exclamation. *** 

Reads- silently without lip movement or whispering. 
Reads without head movement. 

Their abilities will be measured by teacher rating 
and observer checklist. 
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Evaluation : 

This objective was measured by having the student read 
one story out loud and a second story to himsel£. Those 
aspects of the objective which applied to each kind of read- 
ing were checked while the student was reading. The highest 
score a student could receive was six; the students were re- 
quired to obtain such a score for the accomplishment of the 
objective. A t-test for correlated data was used to compare 
the pre-test and post-test scores; Table 83 presents this 
analysis. 



Table 83 

Instructional Objective 1-1 .11 
N, X, SD, % at Criterion and t-ratio 



N= 26 




Pre 


Post 


X 

SD 
% at 


0.0000 

0.0000 

Criterion 0 


2.0000 

2.0939 

0 




Difference 
Between Means 
df 
t 


2.0000 

25 

0.9551* 



* Not significant 
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Table 83 indicates that no student could perform the 
objective on the pre-test; 7% of the students could per- 
form it on the post-test. This percentage was too low for 
the program to accomplish the objective. No significant 
difference existed between the students' performance on 
the pre-test and post-test. A review of the process may 
explain why the program seems to have had no impact on the 
accomplishment of the objective 1-1.11. The evaluators 
recommend that this objective be reviewed for its appro- 
pritaeness for inclusion in the program. In addition, a 
review of the corresponding process should be made to 
determine if incorrect process explains the failure to 
accomplish the objective. Objective 1-1.11 was not accom- 
plished. 



Objective 1-1. IIP : 



The classroom teacher will evaluate each child 
individually at the beginning of the year, and 
group children for instruction. Teachers will 
provide appropriate exercises and opportunities 
to perform at least once a week. These acti- 
vities will be recorded in the lesson plan book. 



Evaluation: 



First grade teachers evaluated each child individually 
at the beginning of the year and grouped them for instruction 
in oral and silent reading. Teachers provided appropriate 
exercises directed toward objective 1-1.11 at least once a 
week for the following percentages of time: 
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December - 87% 
January - 82% 
February - 81% 
March - 95% 
April - 100% 
May - 78% 



This high percentage of the performance of the specific 
process stated for this objective fails to explain the failure 
to accomplish the corresponding product objective. The eval- 
uators suggest that once a week, as required by the objective, 
maybe too infrequent a performance of appropriate activities. 
In addition , a review of the actual processes used for teach- 
ing the skills cited in objective 1-1.11 should be made. 

Objective 1-2.1 : 



At the conclusion of the year 50% of the students 
will be 80% accurate in being able to differen- 
tiate between equivalent and non-equivalent sets 
as measured by teacher-made paper and pencil 
tests. 

Evaluation : 

Students were required to complete a paper and pencil 
test of four questions. On two questions they identified the 
non-equivalnet sets. A score of four was required for the 
accomplishment of the objective, students' performances on 
the pre- and post-tests were compared with a t-test for cor- 
related data, which is summarized in Table 84 . Table 84 indi- 
cates that 17% of the students could perform the objective on 
the pre-test, and 51% could perform it on the post-test. 
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Table 84 



^Instructional Objective 1-2.1 
N , X, SD, % at Criterion and t-ratio 



N=22 





Pre 


Post 


X 


0.0000 


2.0000 


SD 


0.0000 


2.0939 


% at Criterion 


0 


0 







} 





Difference 

Between Means 1.5455 

df 21 

t 4.0489* 



* <.001 ; 

i 

1 

i 

\ 

f 

In addition, a significant difference existed between the \ 

pre- and post-test scores; .so great a difference could have j 

. 1 

occurred by chance less than one time in 1,000. These results j 

suggest that the program had .some impact on the students ' ■ 

! 

knowledge of equivalent and non-equivalent sets. Objective j 

1-2.1 seems to be appropriate for the program as it is stated. 

Objective 1-2.1 was accomplished,. 



Objective 1-2. IP : 



The classroom teacher will evaluate each child 
individually at the beginning of the year and 
group children for instruction. Teachers will 
provide appropriate exercises and opportunities 
to perform at least once a week. These acti- 
vities will be recorded in the lesson plan book. 
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Evaluation : 



Students were evaluated individually at the beginning of 
the year and grouped for instruction. Appropriate exercises 
for learning the concepts of equivalent and non-equivalent sets 
were provided at least once a week for the following percentage 
of time : 

December - 56% 

January - 76% 

February - 90% 

March - 60% 

April - 65% 

May - 47% 

The fact that the objective 1-2.1 was accomplished sug- 
gests that this process was appropriate. 
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Objective 1-2 . 2 : 



At the conclusion of the year 50% of the stu- 
dents will be 80% accurate in associating 
number symbol with a set of objects on a paper 
and pencil test. 



Evaluation : 

Students were required to complete a paper and pencil 
test on which they wrote for each number set pictured the num- 
ber of objects in that set. The highest possible score a 
student could receive was eleven. Students were required, to 
receive a score of nine to accomplish the objective. The 
analysis of the scores is presented in Table 85. 
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Table 85 



^Instructional Objective 1-2.2 
N, X, SD, % at Criterion and t-ratio 





N= 18 




Pre 


Post 


X 
SD 
% at 


10.3333 

1.9149 

Criterion 89 * 


10-7777 

0.9166 

95 




Difference 
Between Means 
df 
t 


0.4444 

17 

1.4098* 



* Not Significant 



A t-test for correlated data compared the pre-test and 
post-test scores. Eighty-nine percent of the students could 
perform the objective on the pre-test. Ninety-five percent 
of the students could perform the objective on the post-test. 
Both percentages are significantly higher than the 50% required 
by the objective. No significant difference existed between 
the pre-test and post-test scores. These results suggest that 
objective 1-2.2 was not appropriate for inclusion in the first 
grade curriculum. It seems evident from Table 85 that the 
majority of students possessed the skill stated in this objec- 
tive before they entered grade one. This skill should be 
considered a readiness skill and as such it should probably 
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be included in the kindergarten objective. The program seems 
to have had limited impact on the accomplishment of this objec- 
tive. Objective 1-2.2 was accomplished. 

Objective 1-2 ,2P : 



The classroom teacher will evaluate each child 
individually at the beginning of the year and 
group children for instruction. Teachers will 
provide appropriate exercises and opportunities 
to perform at least once a week. These acti- 
vities will be recorded in the lesson plan book. 



Evaluation : 



At the beginning of the year teachers evaluated each 



child's skill in naming sets and grouped the children for in- 
struction according to their abilities. Appropriate exercises 
were provided by the teachers for acquisition of skills in these 



areas at least once a week for the following percentage of time: 

December - 75% 

January - 70% 

February - 90% 

March - 86% 

April - 80% 

May - 60% 



These processes seemed to have reinforced the skills that 



the students already possessed when they entered grade one. 



Their •imp ortance for gaining new skills does not seem to be 
significant for this program. The evaluators recommend that 
perhaps the process should focus on identification of sets with 
a large number of t objects in it. A review of the necessity of 



process and product objective 1-2. 2P should be made. 
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Objective 1-2.3 ; 



At the conclusion of the year 50% of the stu- 
dents will be 80% accurate in orally counting 
from 0 to 100. Their ability will be mea- 
sured by teacher rating- and observe checklist. 



Evaluation : 
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Each pupil was individually asked by the teacher to count 
1 from 0 to 100 . A record was made of the highest number to which 
the student could count. The student was required to receive a 
score of 80 or more to accomplish the objective. A t-test for 
correlated data, as presented in Table 86, was used to compare 
the two sets of scores. 

Table 86 

^Instructional Objective 1-2.3 • 

N, X, SD, % at Criterion and t-ratio 



N= 24 


Pre 


Post 


X 28.5000 
SD 23.2558 
% at Criterion 8 


76.9583 

33.1254 

65 


Difference 
Between Means 
df 
t 


48.4583 

23 

7.0329* 


* <.001 
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The results shown in Table 86 indicate that a significant 
difference existed between the pre- and post-test measure of the 
students' ability to count from 0 to 100. Eight percent of the 
students performed at criterion level on the pre-test, while 65% 
of the class performed at the criterion level on the post-test. 
This latter percentage was satisfactory for objective 1-2.3 to 
be accomplished by the program. These results suggest that the 
program had a positive impact on the students ' ability to count 
orally from 0 to 100. Objective 1-2.3 was accomplished. It 
seems to be an appropriate objective for the bilingual program 
grade one classes. 

Obj ective 1-2. 3P ; 

The teacher will practice counting activities 
at least once a week and record the activities 
in the lesson plan book. 

Evaluation : 

The following percent of available time was devoted to 

counting activities at least once a week: 

December - 56% 

January - 88% 

February - 81% 

March - 73% 

April - 95% 

May - 44% 

The fact that product objective 1-2.3 was accomplished 

suggests that this frequency of performing the activities 
specified in process 1-2. 3P was appropriate. The particular 

activities used also seemed to be appropriate. 
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Objective 1-2.4 : 



At the conclusion of the year 50% of the stu- 
dents will be 50% accurate in writing and recog- 
nizing the numbers 0 to 100. This will be mea- 
sured by their written product and paper and 
pencil tests. 



Evaluation : 



Students were presented with a written test on which they 
were asked to write the numbers missing from the set of 0 to 100 
printed on the sheet. The highest possible score a student could 
receive was 100. u In order to accomplish objective 1-2.4 the stu- 
dents were required to receive a score of fifty. A t-test for 



1 


correlated 


data was performed to compare 


the pre-test 




test scores ; this analysis is summarized 


in Table 87. 






Table 87 
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^Instructional Objective 1 


.-2.4 


' 




N, X, SD, % at Criterion and 


t-ratio 






N* 19 








Pre 


Post 




X 


58.1052 


94.9473 




SD 


39.0935 


15.9688 


*: 


% at 


Criterion 53 


89 


i 

ir 

? 

i 




Difference 
Between Means 


36.8421 


i 

[ 




df 


18 


l 

l 

f- 

{ 

| 




t 


4.2194* 


* <. 


001 




t 

* 

> 
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The results shown in Table 87 state that 53% of the stu- 
dents could perform the objective on the pre-test, and 89% of 
the students could perform it on the post-test. Both percen- 
tages are above the 50% required by the objective. The fact 
that a significant difference existed between the pre-test and 
post-test scores, however, suggests that criterion percentage 
of 50% of the students was most likely inappropriate, that is, 
too low. The evaluators recommend that the criterion percen- 
tage be raised in line with the results shown in Table 87. 
Objective 1-2.4 was accomplished. 

Objective 1-2. 4P ; 

Teachers will draw the numbers on the black- 
board and then on paper. They will also work 
with each child individually to trace the num- 
bers. They will perform this activity at least 
once a week and record it in their lesson plan 
book. 

Evaluation : 

The teachers performed the activities stated in the pro- 
cess objective. They had students trace numbers and work with 
numbers at least once a week for the following percentage of time 

December - 75% f 

January - 82% 

February - 90% 

March - 73% 

April - 90% 

May - 60% 

The fact that a significant difference existed between the 
pre-test and post-test scores suggests that the process used for 
accomplishing objective 1-2.4 was appropriate. 
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Objective 1-2.5 : 
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At the conclusion of the year 50% of the stu- 
dents will be able by visual representation to 
demonstrate an understanding of the concepts 
1/2 and 1/4. This will be measured by the stu- 
dents' ability to color in 1/2 and 1/4 of a 
circle on paper. 

Evaluation : 

The students were presented with a pair of circles, one 
of which was divided in half, and with a pair of squares, one 
of which was divided in half. The student was asked to iden- 

• i 

tify each object in the pair which was divided in half. Then 
the student was asked to color 1/4 or 1/2 of six sets of objects. 
The total number of correct responses was eight correct. The 
students were required to answer all questions correctly to 
accomplish the objective. 

The results shown in Table 88 report that 21% of the stu- 
dents received a score of eight on the pre-test; 96% of the 
students received a score of eight on the post-test. In addi- 
tion, a significant difference existed between the pre-test and 
post-test scores at the .001 level as shown in Table 88's repre- 
sentation of the t-test for correlated data done on these two 
sets of scores. These results suggest that participation in the 
program had a significant impact on the students ability to 
under stand the concepts of 1/2 and 1/4. Objective 1-2.5 was 
accomplished. The evaluators note the appropriateness of this 
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Table 88 

^Instructional Objective 1-2.5 
N, X, SD, % at Criterion and t-ratio 



N= 23 



■; 1 








& 

I 







Pre 


Post 


X 


4.8695 


7,7391 


SD 


2.6914 


1.2236 


% at Criterion 


21 


96 



Difference 

Between Means 2.8696 

df 22 

t 4.8301* 



* <.001 

objective and recommend that it be included in the program for 
the next project year. 



Objective 1-2. 5P : 



Teachers will prepare and use worksheets at least 
once a week. They will ask children to color in 
1/2 or 1/4 of objects. They will record these 
activities in their lesson plan books. 



Evaluation : 

Interviews with project teachers and observation of first 
grade classes indicated that the teachers felt that the objec- 
tive was not appropriate for instruction at the beginning of 
the year, but was appropriate for the end of the year. The 
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fsct the 96% of ths students could perform ths objective by 
the end of the year confirms their reports. Teachers provided 
worksheets at least once a week at the end of the year for 
the following percentage of weeks: 



The general trend of the frequency of this activity to in- 
crease supports the teachers' comments about performance of the 
instructional process. The fact that product objective 1-2.5 
was accomplished suggests that appropriateness of the correspond 
ing process objective. 

Objective 1-2.6 : 

At the conclusion of the year 20% of the classes 
will be 80% accurate in orally reading the ordi- 
nal numbers 1 to 20. (first, second, twentieth) . 

Their skills will be measured by teacher rating 
and observer checklist. 

Evaluation : 

The students were shown a series of pictures and asked to 
identify the ordinal position of a particular picture on the 
card. The highest possible score a student could receive on 
this test was ten. in order to accomplish objective 1-2.6 



\ 



December - 0% 

January - 11% 
February - 27% 
March - 43% 
April - 75% 
May - 30% 



30% 



the students were required to answer eight questions correctly 
The t-test for correlated data used to compare the pre— test 

and post-test scores is summarized in Table 89. - 
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Table 89 
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instructional Objective 1-2.6 
N, X, SD, % at Criterion and- t-ratio 



N= 17 





Pre 


Post 


X 


4.2352 


8.7647 


SD 


3.3171 


1.2616 


% at Criterion 


21 


31 



* <.001 

The data shown in Table 89 report that 21% of the students 
could perform the objective on the pre-test, and 31% of the 
students could perform it on the post-test. Both percentages 
were appropriate for the accomplishment of the objective. Yet 
the fact that a significant difference existed between the pre- 
test and post-test scores, a difference which could have occur- 
red by chance less than one time in 1,000 suggests that the 
progr am had a positive impact upon the students ' achievement in 
the area of knowledge of ordinal numbers. The evaluators recom- 
mend, based on the data presented in Table 89, that the program 
consider raising the criterion • level required for the accomplish- 
ment of this objective so that it will not be satisfied at the 
time of the pre-testing. Objective 1-2.6 was accomplished. 



217 



214 



II I 

Is 

M 



Is 

is 





- 




Difference 
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Between Means 




df 


16 
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5.2267* 
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Objective 1-2. 6P: 



The classroom teacher will evaluate each child 
individually at the beginning of the year and 
group children for instruction. Teachers will 
provide appropriate exercises and opportunities 
to perform at least once a week. These activi- 
ties will be recorded in the lesson plan book. 



Evaluation : 



The classroom teachers evaluated each child individually 
either formally or informally at the beginning of the year. 
Children were then grouped for instruction. Appropriate acti- 
vities directed toward the learning of the ordinal numbers one 
to twenty were performed at least once a week for the following 



These small percentages suggest that perhaps a larger num- 



view the appropriateness of this process objective and determine 




December - 31% 
January - 58% 
February - 54% 
March - 34% 

m I « m p A 



March 

April 

May 



- 55% 



25% 



ber of students could have performed the objective if processes 
directed toward accomplishing objective 1-2.6 were performed 
more frequently. The evaluators recommend that the program re- 



whether the project should structure and enforce its occurrence 
at least once a week in the classroom. 
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Evaluation : 

Students were required to solve ten of twelve addition 
problems of two addends with no remaining using expanded 
notation to satisfy objective 1-2.12. A t-test for correlated 
data was used to compare the pre-test and post-test scores 
in this measure; this analysis is summarized in Table 95. 

Table 95 

instructional Objective 1-2.12 
N, X, SD, % at Criterion and t-ratio 



N= 27 




Pre 


Post 


X 

SD 

% at 


0.0000 

0.0000 

Criterion 0 


3.5185 

3.4999 

29 




Difference 
Between Means 
df 
t 


3.5185 

26 

1.0053* 



* Not Significant 



Table 95 reports that the students did not accomplish this 
objective. No students satisfied the criterion on the pre-test, 
and only 29% of the students solved the required ten problems 
on the post-test. In addition, no significant difference existed 
between the pre-test and post-test scores. The evaluators note 
that a review of this objective and its appropriateness for 



232 



229 




Objective 1-2.7 : 



At the conclusion o£ the year 40% of the class 
will be 80% accurate in their ability to use a 
number line to show number sequence. Their 
ability will be measured by teacher rating and 
observer checklist. 






ii 




Evaluation ; 

The teacher displayed a number line for the student. Each 
child was then asked to read three sequences of numbers from 
the line. If the sequence of numbers was read correctly the 
student was given credit for his response . students were re- 
quired to answer the three questions correctly to accomplish 
objective 1-2.7. Table 90 summarizes the analysis of parti- 
cipants' scores; a t-test for correlated data was employed. 

The results summarized in Table 90 note that no student 
could perform objective 1-2.7 on the pre-test. In contrast , 

96% of the students could perform the objective on the post- 
test. As might be expected from these percentages, a signi- 
ficant difference at the .001 level existed between the 
pre-test and post-test scores. These results suggest that 
the bilingual program had a positive impact on the students' 
ability to use the number line to show number sequence. The 
evaluators recommend that this objective be included in the 
program for the next project year. The evaluators also sug- 
gest, however, that the program staff should review the appro- 
priateness of the criterion level of 40% specified in the 
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inclusion in the first grade curriculum should be made. Either 
a lowering of the criterion percentage should be considered, or 
revisions in the process activities directed at this objective 
should be made. The program seems to have had very limited 
impact on the achievement of objective 1-2.12. 

A* 

Objective 1-2, 12P ; / 



The classroom teacher will evaluate e^ch child 
individually at the beginning of the year and 
group children for instruction. Teachers will 
provide appropriate exercises and opportunities 
to perform at least once a week. These activi- 
ties will be recorded in the lesson plan book. 



I - ' 







Evaluation ; 

The first grade classroom teachers evaluated the children 
individually at the beginning of the year on their arithmetic 
skills; they were then grouped for instruction. Teachers pro- 
vided appropriate exercises directed toward the students' 
acquisition of skill in adding in expanded notation at least 
once a week for the following percentage of the time: 

December - 6% 

January - 98% 

February - 9% 

March - 30% 

April - 70% 

May - 91% 

No decisive pattern of performance frequency is evident; 
this may explain the lack of significant difference between the 
pre-test and post-test scores on product objective 1-2.12. It 
is Imp erative that a review of the processes used for the 
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Table 90 



^Instructional Objective 1-2.7 
N , X , SD , % at Criterion and t-ratio 

. ~ .V 



N= 27 





Pre 


Post 


X 


0.0000 


2.8888 


SD 


0.0000 


0.5667 


% at 


Criterion 0 


96 




Difference 
Between Means 


2.8888 




df 


26 




t 


5.0975* 



* <.001 



objective. They might consider raising this criterion level 
in line with the performance of the students indicated in Table 
90. Objective 1-2.7 was accomplished. 



Objective 1-2 .7P : 



The teacher will ask students to name the num- 
bers before, after, and between designated 
portions of the number line. These activities 
will be conducted at least once a week and 
recorded in the lesson plan book. 



Evaluation : 



I 







Teachers conducted the activities specified in process 
objective 1-2.7P at least once a week for the following per- 
centage of time: 



217 



220 





; * f? rT Y'T **■; 



accomplishment of this product objective be made. It also seems 
possible that the process performed for objective 1-2. IIP 
were not appropriate for the accomplishment of objective 2.12. 

Objective 1-2.13 ; 

At the conclusion of the year, 60% of the class 
will be 90% accurate in using the number line 
for addition. This will be measured by a paper 
and pencil test . 

Evaluation ; 

Table 96 shows the results of the t-test for correlated 
data used to assess objective 1-2.13. Table 96 also indicates 
that 11% of the students achieved the objective on the pre- 
test, and 36% accomplished it on the post-test. These students 
were assessed on this objective by their solutions tb twelve 
| problems involving the use of the number line to find a sum. 

Students were required to answer eleven of twelve questions 
correctly. 

i 

l 

Although a sufficient percentage of the students did 

| 

not reach the criterion level specified in the objective, a 
significant difference existed between the pre-test and post- 
j test scores. The pattern of performance suggests the recom- 

I mendation that the project staff should review the appropriate- 

i ness of the criterion level included in the objective. The fact 

l 

that a significant gain occurred between pre- and post-testing 
suggests that the bilingual program had some impact on the 
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December - 93% 

January - 82% 

February - 90% 

March - 82% 

April - 95% 

May - 67% 

The high frequency of process activity 1-2.7 explains the 
accomplishment of the objective. This process seems to be appro- 
priate for its corresponding product and should be implemented 
for the next project year. 

Objective 1-2 . 8 ; 

At the conclusion of the year 40% of the stu- ' 
dents will be 80% accurate in combining sets 
of objects up to twelve. This will be measured 
by teacher rating and observer checklist. 

Evaluation ; 

Table 91 presents the analysis of the scores on this mea- 
sure; a t-test for correlated data was performed. The results 
summarized in Table 91 indicate that 15% of the students could 
perform the objective on the pre-test, and 70% of the stu- 
dents could perform it on the post-test. This 70% is greater 
than the 40% required in the objective. In addition, a sig- 
nificant difference existed between the pre-test and post-test 
scores, as shown in Table 91. A difference so large could have 
occurred by change less them one time in 100. Students were mea- 
sured in objective 1-2.8 by being required to solve five of six 
problems correctly. Objective 1-2.8 seems to be appropriate for 
the bilingual program. The impact of participation in this 
program on the accomplishment of this objective is evidenced 



221 218 



7 



Table 96 

^Instructional Objective 1-2.13 
N, X, SD, % at Criterion and t-ratio 



S': 



N= 19 






Pre Post 


X 




2.9473 9.9473 


SD 




3.8040 2.3503 


% at 


Criterion 


11 36 




Difference 






Between Means 


7.0000 




df 


18 




t 


8.0589* 



* <.001 



students' ability to use the number line for addition. The pro- 
ject should consider revising the criterion level of 60% to 
make it more in line with the ability of students. In this case 
this would require lowering the criterion percentage. Objective 
1-2.13 was not accomplished. 

Objective 1-2 .13P : 

The classroom teacher will evaluate each child 
individually at the beginning of the year and 
group children for instruction. Teachers will 
provide appropriate exercises and opportunities 
to perform at least once a week. These acti- 
vities will be recorded in the lesson plan book. 
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Table 91 



^Instructional Objective 1-2.8 
N, X, SD, % at Criterion and t-ratio 



N= 27 





Pre 


Post 


X 


3.8518 


5.3703 


SD 


2.4601 


1.1910 


% at Criterion 


15 


70 



Difference 

Between Means 1.5185 

df 26 

t 2.9768* 



* <.01 

in Table 91. Objective 1-2.8 was accomplished. The evaluators 
recommend that this objective be included in the program for 
the next project year. 



O bjective 1-2 .8P ; 



The teacher will encourage free play in which 
students create two sots of objects with no 
more them six objects per set, and combine the 
sets, discovering the number of objects in the 
joined set. These activities will be recorded 
in the lesson plem book. 
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Evaluation : 



Evaluation and grouping o£ students occurred at the be- 
ginning of the school year. Teachers provided appropriate 
exercises directed at the students' use of the number line 
for addition at least once a week for the following percent 
of time: 

December - 75% 

January - 82% 

February - 81% 

March - 82% 

April - 85% 

May - 62% 

The evaluator feels that this high frequency of process 
performance suggests the possibility that the particular acti- 
vities used may not be appropriate for accomplishing the 
corresponding product objective. Because a satisfactory 
percentage of students did not accomplish objective 1-2.13 
even though the process 1-2. 13P was, for the most part, per- 
formed, the activities involved in this process may not be 
appropriate for the accomplishment of the product objective 
or that once a week is too infrequent a performance. The 
evaluators recommend that a review of objective 1-2. 13P 
occur, with the consideration of implementing a more highly 
structured monitoring and use of this process in the class- 
room. 

Objective 1-2.14 : 





At the conclusion of the year 40% of the students 
will be 80% accurate in subtracting zero from a 
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Evaluation : 



Observation of classes and discussion with first grade 
teachers indicated that they encouraged free play in which 
students worked with sets of no more than six objects. The 
students' play involved combining the sets and discovering 
the number of objects in the two joined sets. Teachers 
structured activities directed at accomplishing objective 
1-2.8 at least once a week for the following percentage of 
time: 

December - 31% 

January - 82% 

February - 100% 

March - 91% 

April - 90% 

May - 71% 

This high percentage of time seems congruent with the 
accomplishment of objective 1-2.8. The appropriateness of 
process 1-2. 8P for accomplishing the corresponding product 
objective is evident. Equally evident is the appropriateness 
of the frequency with which the process was performed. 



Objective 1-2.9 : 

At the conclusion of the year 40% of the students 
will be 80% accurate in adding two numbers in the 
horizontal or vertical forms. 5+4=9. 5 

+4 

as measured by paper and pencil test. 
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number and the number £rom itself. This will be 
measured by a paper and pencil test. 

Evaluation ; 

Students solved fourteen subtraction problems which re- 
quired either subtracting zero £rom a number or subtracting 
a number from itself. Students were required to answer twelve 
of fourteen questions correctly in order to accomplish objec- 
tive 1-2.14. A t-test for correlated data was used to compare 
the pre-test and post-test scores; the analysis is summarized 
in Table 97. 



Table 97 



instructional Objective 1-2.14 
N, X, SD, % at Criterion and t-ratio 



N= 27 



Pre 



Post 



X 

SD 

% at Criterion 



2.8888 

3.9189 

3 



12.4074 

2.9471 

62 



Difference 
Between Mean 



9.5186 

26 

9.9671* 



df / 
t 



* <.001 
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Evaluation ; 

The students solved twelve addition problems written 
in vertical form and nine addition problems written in hori- 
zontal form. They were required to obtain a score of seven- 
teen of twenty-one possible to accomplish the objective. 

Table 92 

instructional Objective 1-2.9 
N, X, SD, % at Criterion and t-ratio 



X 

SD 

% at Criterion 



N= 20 



Pre Post 



8.0500 18.5000 

6.7858 5.1234 

23 45 



Difference 

Between Means 10.4500 

df 19 

t 5.9933* 



* <.001 
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The results shown in Table 92 indicate that 23% of the 
students received the score of seventeen on the pre-test 
required for satisfaction of the objective, while 45% received 
such a score on the post-test. In addition, the results of 
the t-test for correlated data, shown in Table 92, state that 
the post-test percentage of 45% was high enough to satisfy the 
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The results shown in Table 97 state that 3% of the stu- 
dents could perform the subtraction activity on the pre-test, 
while 62% of the students received the score of twelve re- 
quired by the objective on the post-test. In addition, a 
highly significant difference at the .001 level existed between 
the pre-test and post-test scores. Because 62% of the students 
accomplished the objective on the post-test, a higher percen- 
tage than the 40% required by the objective, and because a sig- 
nificant difference existed between the two sets of scores, 
participation in the bilingual program had a positive effect on 
the students' ability to subtract zero from a number and a 
number from itself. The evaluators recommend that this objec- 
tive be included in the project for the next program year. 
Objective 1-2.14 was accomplished. 

Objective 1-2. 14P : 

The classroom teacher will evaluate each child 
individually at the beginning of the year and 
group children for instruction. Teachers will 
provide appropriate exercises and opportunities 
to perform at least once a week. These acti- 
vities will be recorded in the lesson plan book. 

Evaluation : 

The first grade teachers evaluated each child individually 
at the beginning of the year and then grouped them for instruc- 
tion in the arithmetic skill's. Appropriate exercises directed 
toward subtraction of zero from a number or a number from 
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criterion of 40% of the class specified in the objective. A 
significant difference existed at the .001 level between the 
pre-test and post-test scores. Participation in the bilingual 
program seems to have affected the students' ability to add 
horizontally or vertically. Objective 1-2.9 seems to be appro- 
priate for inclusion in the bilingual program. The evaluators 
recommend that this objective be included in the next year's 
program . 

Objective 1-2. 9P : 

The classroom teacher will evaluate each child 
individually at the beginning of the year , and 
group children for instruction. Teachers will 
provide appropriate exercises and opportunities 
to perform at least once a week. These activi- 
ties will be recorded in the lesson plan book. 

Evaluation : 

All first grade teachers evaluated each child individually, 
either formally or informally, at the beginning of the school 
year and then grouped them for instruction in arithmetic. Appro- 
priate exercises which were directed toward acquisition of skills 
to add vertically and horizontally were provided at least once 
a week for the following percentage of time: 



December - 87% 
January - 88% 
February - 100% 



March 

April 

May 



95% 

100 % 

77% 




itself were performed at least once a week for the following 
percentage of time : 



This frequent performance of objective 1-2. 14P explains the 
accomplishment of its corresponding product objective . Because 
objective 1-2.14 was accomplished, it seems reasonable to con- 
clude that the process used to achieve it was appropriate. The 
evaluators recommend that this process be documented and included 
in the instructional program for the next project year . 

Objective 1-2.15 ; 

At the end of the year 40% of the students will 
80% of the time accurately complete two-digit 
subtraction with no re-grouping. This will be 
measured by a paper and pencil test. 

Evaluation : 

Students completed a worksheet of twelve subtraction pro- 
blems, described as two-digit subtraction with no re-grouping. 
Students were required to solve ten of twelve problems cor- 
rectly to accomplish the objective. The percentage at 
criterion and the t— test for correlated data used to compare 
pre- and post-test scores are presented in Table 98. 



December 

January 

February 

March 



April 

May 



62% 

58% 

90% 

86 % 

95% 

67% 
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This high frequency of performance of the process objec- 
tive is congruent with the accomplishment of the corresponding 
product objective. In addition, process 1-2. 9P seems to be 
appropriate for the accomplishment of product objective 1-2 . 9 . 
The evaluators recommend that this process objective be included 
in the next year's program in its present form. 

Objective 1-2 . 10 : 

At the conclusion of the year 30% of the stu- 
dents will be 80% accurate in column addition 
with three addends with sums through twelve as 
measured by a paper and pencil test. 

Evaluation : 

Students were given a worksheet containing twelve problems 
involving column addition with three addends. Students were 
required to obtain a score of ten of twelve items correct to 
accomplish objective 1-2.10. A t-test for correlated data was 
performed on the two sets of scores and summarized in Table 93. 



Table 93 indicates that the students accomplished the objec- 
tive on the post-test but not on the pre-test. Eighteen percent 
of the students on the pre-test and 72% of them on the post-test 
were 80% accurate in column addition. A significant difference, 
as shown in Table 93, was found between the pre-test and post- 
test scores, a difference which could have occurred by chance 
less them one time in 1,000. These results in Table 93 suggest 
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Table 98 





^Instructional Objective 1 
N, X, SD, % at Criterion and 


-2.15 

t-ratio 




in 

CM 

53 




Pre 


Post 


X 


0.4000 


6.7200 


SD 


1.9595 


3.9549 


% at 


Criterion 4 


25 




Difference 


, 




Between Means 


6.3200 




df 


24 




t 


7.3676* 



* <.001 







The results summarized in Table 98 report that the appro- 
priate percentage of the students did not accomplish the objec- 
tive. Only 25% of the students satisfied objective 1-2.15 on 
the post-test , whereas 40% of the students were required to do 
so for the program to accomplish the objective. Because a 
significant difference existed between the pre-test and post- 
test scores , the required percentage of students might be too 
high for the program. Program participation, therefore, seemed 
to have some impact on the students' skill in solving two-digit 
subtraction problems with no re-grouping. The evaluators recom- 
mend that, in light of this data, the project staff should 
review the appropriateness of the percentage of 40% specified 
in the product objective. Objective 1-2.15 was not accomplished. 
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Table 93 

^Instructional Objective 1-2.10 
N, X, SD, % at Criterion and t-ratio 



N= 24 





Pre 


Post 


X 


5.6250 


9.3333 


SD 


4.2112 


2.9533 


% at Criterion 


18 


72 



Difference 

Between Means 3.7083 

df 23 

t 4.8480* 



* <.001 



that the program had a positive impact on the students' acquisi- 
tion of skill in column addition with three addends. The 
evaluators recommend the inclusion of this objective in the 
1971-72 program, as it seems to be an appropriate one for first 
grade students. Objective 1-2.10 was accomplished. 



Objective 1-2, 10P : 
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The classroom teacher will evaluate each child 
individually at the beginning of the year and 
group children for instruction. Teachers will 
provide appropriate exercises and opportunities 
to perform at least once a week. These activi- 
ties will be recorded in the lesson plan book. 
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Objective 1-2. 15P ; 



The classroom teacher will evaluate each child 
individually at the beginning o£ the year, and 
group children for instruction. Teachers will 
provide appropriate exercises and opportunities 
to perform at least once a week. These acti- 
vities will be recorded in the lesson plan book. 



Evaluation : 

Each student was evaluated at the beginning of the year by 

his classroom teacher and grouped for instruction in arithmetic. 

Teachers provided exercises directed at learning subtraction 

skills for two-digit numbers without re-grouping at least once 

a week for the following percentage of time: 

December - 18% 

January - 11% 

February - 18% 

March - 8% 

April - 30% 

. May - 71% 

This low frequency of performance of process 1-2. 15P per- 
haps explains the reason objective 1-2.15 was not accomplished. 
The actual activities performed seemed to be appropriate, how- 
ever, as a significant difference existed between the pre-test 
and post-test scores, suggesting that the program had some impact 
on the students' skill in this type of subtraction. The results 
also suggest, however, that a greater frequency of performance 
of the process activity might have helped a larger percentage 
of students to achieve the objective. 
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Evaluation : 
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All first grade students were evaluated individually at 
the beginning of the year, and then grouped for instruction 
in arithmetic. Appropriate exercises directed toward skill 
in column addition with three addends were performed at least 
once a week for the following percentage of time: 



December - 12% 

January - 11% 

February - 45% 

March - 39% 

April - 80% 

May - 59% 

Although the frequency of performance of process 1-2.10 
was generally less than one-half its projected frequency, its 
performance seems to have been sufficient for the accomplishment 
of the corresponding product objective. The evaluators suggest 
that the project staff review process objective 1-2.10 and deter- 
mine if performance of the process activity should be required 
less frequently. The process itself, however, and the activi- 
ties involved seem to be appropriate for the accomplishment of 
product objective 1-2.10. 



Objective 1-2 . 11 : 



At the conclusion of the year 40% of the stu- 
dents will be 80% accurate in two-digit addi- 
tion of three addends with no remaining. This 
will be measured by paper and pencil tests. 
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Objective 1-2.16 : 



At the end of the year 40% of the students will 
be 80% accurate in measuring line segments of 
foot , inch and half-inch . This will be measured 
by teacher rating and observer checklist. 
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Evaluation : 

Students were requested to complete a worksheet which 
asked them to measure three line segments using the measure- 
ments foot, inch, and half-inch. In order to accomplish 
objective 1-2.16 the students were required to answer all 
three questions correctly. A t-test for correlated data com- 
pared the pre-test and post-test scores; the analysis is 
summarized in Table 99. 

Table 99 

instructional Objective 1-2.16 
N, X, SD, % at Criterion and t-ratio 



N= 26 





ik 

* Pre 


Post 


X 


0.5384 


3.3076 


SD 


0.7956 


1.1692 


% at 


Criterion 0 


17 




Difference 
Between Means 


2.7692 




df • 


25 




t 


10.9758* 



* <.001 
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Evaluation : 



Students were asked to solve twelve problems involving 
column addition of three addends, each with two digits. Stu- 
dents were required to answer ten of twelve problems correctly 
to accomplish objective 1-2.11. A satisfactory percentage of 
students did not accomplish the objective on either the pre- 
test or the post-test. Only 5% of the students were 80% 
accurate in their responses to the worksheet of problems on the 
pre-test, and only 13% were 80% accurate on the post-test, as 
shown in Table 94 . 

Table 94 

^Instructional Objective 1-2.11 
N, X, SD, % at Criterion and t-ratio 
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N= 19 




Pre 


Post 


X 


0.5263 


6.7368 


SD 


2.2329 


4.5750 


% at 


Criterion 5 


13 




Difference 






Between Means 


6.2105 




df 


18 




t 


5.8369* 



* <.001 
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Table 99 indicates that no student accomplished the objec- 
tive on the pre-test , and 17% of the students performed the 
objective on the post-test. This percentage was not significant 
for the accomplishment of the objective by the program, as 40% 
of the students were required to do so. It is important to note 
that a highly significant difference existed, however, between 
the pre-test and post-test scores, a difference which could have 
occurred by chance less them one time in 1,000. This statistic 
suggests that the criterion level established in the objective 
may be too high for the program population. The program did 
seem to have a positive impact on the students* ability to know 
the concepts foot, inch, and half-inch. A review of the cri- 
terion of 40% required in the objective should be made. Refer- 
ence to the discussion on the process directed toward accom- 
plishing this objective may also indicate why the appropriate 
percentage of students were not able to perform this objective. 
Objective 1-2.16 was not accomplished. 

Objective 1-2. 16P : 



r’ 







The classroom teacher will evaluate each child 
individually at the begining of the year, and 
group children for instruction. Teachers will 
provide appropriate exercises and opportunities 
to perform at least once a week. These activi- 
ties will be recorded in the lesson plan book * 



Evaluation : 



Students' abilities in performing arithmetic skills were 
evaluated at the beginning of the year . The students were then 
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A t-test for correlated data was performed to determine 
if program participation had any impact on this skill; the 
analysis is presented in Table 94. A significant difference 
between the students' pre-test and post-test scores existed. 
This observation suggests that the criterion level of 40% of 
students required to accomplish the objective may be too high. 
Or a review of process may reveal lack of exercises directed at 
acquisition of this skill. The evaluators recommend that the 
project staff review this objective and consider changing the 
criterion level so that it is in line with the results of the 
measurement of this objective, if the process is appropriate. 
Objective 1-2.11 was not accomplished. 

Objective 1-2. IIP : 

The classroom teacher will evaluate each child 
individually at the beginning of the year, and 
group children for instruction. Teachers will 
provide appropriate exercises and opportunities 
to perform at least once a week. These activi- 
ties will be recorded in the lesson plan book. 

Evaluation : 

Fi^st grade children were evaluated and grouped for in- 
struction at the beginning of the year. Arithmetic activities 
began at that time, but teachers reported to the evaluator 
that activities focusing on column addition with three addends, 
each with two digits, were the focus of activities only in 
the latter part of the year. The percentage of teachers who 
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grouped for instruction. Teachers provided appropriate exer- 
cises directed at learning the concepts of foot, inch, half- 
inch at least once a week for the following percentage of time 
during the period when process activities were monitored: 

December - 12% 

January - 11% 

February - 18% 

March - 8% 

April - 30% 

May - 19% 

Interviews with classroom teachers indicated that the reason 
for such a low frequency of performance of process 1-2.16 was 
the difficulty of this measurement for the first grade students. 
This comment confirms the reason for the lack of achievement of 
the corresponding product objective. The evaluators recommend 
a determination of the appropriateness of the product and process 
objective 1-2.16 and 1-2. 16P for inclusion in the first grade 
curriculum. 

Objective 1-2 . 17 : 



At the conclusion of the year 60% of the students 
will be 80% accurate in distinguishing pints and 
quarts. This will be measured by teacher rating 
and observer checklists. 



Evaluation: 



The students were required to answer eight questions, two 
of which involved determining the number of pints which equalled 
a quart and the number of quarts which equalled a pint. The 
remaining six questions involved identifying the larger of two 
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performed appropriate activities and provided exercises at 
least once a week supports this comment: 



For the most part these percentages indicate a trend toward 
more frequent use of activities which focused on the addition of 
three two-digit addends as the year progressed. The fact that 
the criterion level specified in the product objective was 
accomplished, further suggests that this objective is not neces- 
sarily appropriate for first grade children. The evaluators 
recommend that a review of the appropriateness of both process 
and product objective 1-2. IIP and 1-2.11 occur. The program 
staff should consider either a more frequent performance of the 
process by the first grade teachers. 

Objective 1-2.12 : 

At the conclusion of the year 60% of the students 
will be 80% accurate in two-digit addition of two 
addends with no remaining, using expanding notion. 



December - 0% 

January - 0% 

February - 18% 



March 

April 

May 



0 % 

35% 

44% 



32 - 30 + 2 
24 = 20 + 4 



50 + 6 - 56 



This will be measured by a paper and pencil test 
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measures using -the concepts of pints and quarts. Students were 
required to answer seven of the eight questions correctly in 
order to accomplish objective 1-2.17. A t-test for correlated 
was employed to analyze the scores; its summary is presented 
in Table 100. 

Table 100 

Instructional Objective 1-2.17 
N, X, SD, % at Criterion and t-ratio 
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N= 27 
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Pre 


Post 


■ !' 


X 


2.1481 


6.5185 


SD 


1.2081 


1.2582 




% at Criterion 


0 


52 


h. 




* 




r/-.; 

£ ' ' 




Difference 
Between Means 


4.3704 




df 


26 


% 




t 


14.2265* 









* <.001 

The results in Table 100 note that no student could per- 
form objective 1-2.17 on the pre— test, while 52% of the students 
could perform it on the post-test, although this percentage 
does not satisfy that required by the objective for the pro- 
gram's accomplishment of the objective. However, a significant 
difference at the .001 level existed between the pre-test and 
post-test scores. These results suggest that participation in 
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the bilingual program had a significant impact on the students' 
ability to distinguish pints and quarts. The evaluators recom- 
mend that the program review the appropriateness of 60% of 
the students required to accomplish the objective , although 
such a large percentage may be appropriate because almost 60% 
accomplished the objective. A review of the frequency of the 
process objective may indicate why a larger number of students 
did not accomplish the objective. Objective 1-2.17 was not 
accomplished. 



!: 




Objective 1-2 . 17P ; 



The classroom teacher will evaluate each child 
individually at the beginning of the year and 
group children for instruction. Teachers will 
provide appropriate exercises and opportunities 
to perform at least once a week. These acti- 
vities will be recorded in the lesson plan book. 



Evaluation : 



Students were evaluated individually and grouped for arith- 



metic instruction at the beginning of the school year. Teachers 
provided appropriate exercises for learning the concepts of pints 
and quarts at least once a week for the following percentage of 
time : 

December - 0% 

January - 98% 

February - 27% 

March* - 4% 

April - 25% 

May - 16% 
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This low frequency of performance of process 1-2. 17P ex- 
plains the reason for the lack of accomplishment of objective 
1-2.17. The evaluators note that this process seems to be 
appropriate for the accomplishment of the corresponding pro- 
duct objective because of the significant difference between 
pre and post scores. The evaluators recommend, however, that 
a closer monitoring of the frequency of performance of this pro- 
cess objective be done to insure that the teachers discuss 
the concepts of pints and quarts more frequently than they 
did during the current program year. 
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Ob j ective 1-2.18 ; 

At the conclusion of the year 80% of the stu- 
dents will be 80% accurate in recognizing the 
concepts of day, week, month, and year. This 
will be measured by teacher rating and observer 
checklist. 

Evaluation ; 

Students were asked a series of six questions about the 
concepts of day, week, month, and year. They were required to * 
answer five of the six questions correctly to accomplish the 
objective. 

The results shown in Table 101 indicate that no student 
achieved the criterion on the pre-test, and no student achieved 
the criterion on the post-test. However, the t-test for cor- 
related data summarized in Table 101 showed that a significant 
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Table 101 





instructional Objective 1 
N, X, SD, % at Criterion and 


-2.18 

t-ratio 




N= 25 




Pre 


Post 


X 


0.4000 


0.9200 


SD 


0.5656 


1.0166 


% at 


Criterion 0 


0 




Difference 






Between Means 


0.5200 ' 




df 


24 




t 


2.8337* 



* <.01 



difference existed between the pre-test and post-test scores. 
These results suggest participation in the program had some 
impact on the students' knowledge of the concepts of day, week, 
month, and year, but not as significant an impact as possible. 

The evaluators recommend that the program staff review the appro- 
priateness of the objective. They should consider the criterion 
level specified and whether the concept itself is an appropriate 
one for teaching in the grade one classes. Objective 1-2.18 was 
not accomplished. 

Objective 1-2. 18P : 

The classroom teacher will evaluate each child 
individually at the beginning of the year, and 
group children for instruction Teachers will 
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provide appropriate exercises and opportunities 
to perform at least once a week. These activi- 
ties will be recorded in the lesson plan book. 



Evaluation : 



All first grade teachers evaluated each child in their 
class individually at the beginning of the year. Children 
were then grouped for instruction. Teachers provided acti- 
vities directed toward learning the concepts of day, week, 
month, and year at least once a week for the following per- 
centage of time : 

December - 62% 

January - 70% 

February - 81% 

March - 82% 

April - 95% 

May - 72% 

These percentages suggest that the lack of accomplishment 
of product objective 1-2.18 probably cannot be attributed to 
the failure of teachers to perform the process objective as 
stated. It seems that either the product criterion level is 
inappropriate , or that performing the process once a week was 
not sufficient. The evaluators recommend that a review of 
process objective 1-2. 18P occur. 

Objective 1-2 . 19 : 



At the conclusion of the year 80% of the students 
will be 80% accurate in using time concepts of 
hour and half-hour in the. classroom. This will 
be measured by teacher rating and observer check- 
list. 
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Evaluation: 

This objective was tested by requiring students to iden- 
tify the time on a series of five clocks. In order to accom- 
plish objective 1-2.19 students were required to answer four of 
five questions correctly. Table 102 indicates that 3% of the 
students could perform the objective on the pre-test, while 
40% of the students could perform it on the post-test. 

Table 102 

instructional Objective 1-2.19- 
N, X, SD, % at Criterion and t-ratio 



N= 27 



X 

SD 

% at Criterion 



Pre Post 

1.4814 3.5555 

1.1343 0.8315 

3 40 



■ i 




* <.001 



Difference 

Between Means 2.0741 

df 26 

t 10.0635* 



In spite of the fact that the criterion level of 80% 
specified in the objective was not obtained, and that objec- 
tive 1-2.19 was not accomplished, a significant difference 
existed between the pre-test and post-test scores as shown 
by the t-test for correlated data summarized in Table 102 , 



247 



250 





Based on this data, the evaluators recommend that the project 
staff review the appropriateness of the project objective. 

A review of the process and its frequency may also indicate 
more clearly why the product was not obtained. Objective 
1-2.19 was not accomplished. 



Objective 1-2. 19P ; 



The classroom teacher will evaluate each child 
individually at the beginning of the year and 
group children for instruction. Teachers will 
provide appropriate exercises and ' opportunities 
to perform at least once a week. These acti- 
vities will be recorded in the lesson plan book. 



Evaluation: 



Children were tested individually at the beginning of the 
year, either formally or informally; instructional groups were 
then formed. Teachers provided appropriate exercises for learn- 
ing the concepts of half-hour and hour at least once a week for 
the following percentage of time: 

December - 6% 

January - 41% 

February - 63% 

March - 47% 

April - 75% 

May - 34% 

These percentages indicate that, for the most part, the 
teachers were performing the process less than one-half as fre- 
quently as they should have been performing it. These results 
suggest to the evaluators that a more careful monitoring of the 
performance of process 1-2.19 should occur, if indeed it is 
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considered to part of an appropriate objective. The evaluators 
recommend that an immediate review of this process occur; if it 
is included in the program for the next project year, a careful 
structuring of its use in the classroom should be made and 
enforced . 

Objective l-3.l t 

The student will demonstrate a comfortableness 
with French in the classroom as demonstrated by 
90% of the class showing willingness to parti- 
cipate at least once in class discussion. This 
will be recorded by observer checklist. 

Evaluation ; 

This objective was measured by the teachers' presenting a 
group of French speaking children a brief paragraph in French 
which ended with a question. Children were asked to respond to 
the question. Their use of standard expressions and pronoun- 
ciations was also monitored. Students received credit for the 
objective if they participated in the conversation. A sign 
test for correlated data was used to compare the pre-test and 
post-test scores; this analysis is summarized in Table 103. 

Table 103 indicates that 76% of the students demonstrated 
a comfortableness with French in the classroom on the pre-test, 
while 70% of the students demonstrated such a comfortableness 
on the post-test. No significant difference existed between 
the pre-test and post-test scores. Neither pre-test nor post- 
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Table 103 

Instructional Objective 1-3.1 
Summary of Sign Test for Correlated Data 
and Percent at Criterion Level 



Number with Pre and Post Scores 
Number Showing Positive Change 
Number Showing Negative Change 
z 
P 



20 

4 

0 

1.5000 

not significant 



% at Criterion-Pre 56 

% at Criterion-Post 70 







test percentage was sufficiently high to satisfy the 90% speci- 
fied in the objective. The program seems to have had a limited 
impact on the students comfortableness with French in the class- 
room. Since this seems to be a very important goal of the 
bilingual program, the evaluators recommend that the project 
staff review this objective. Simultaneously a review of the 
accompanying process should be made to determine the best way 
for accomplishing objective 1-3.1. Appropriate changes should 
then be implemented. Objective 1-3.1 was not accomplished. 

Objective 1-3 .IP : 

The teacher will provide daily opportunity for 
discussion in French. The teacher will not dis- 
courage the children's use of their patois French. 
Activites will be recorded in the lesson plan 
book. 
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Evaluation : 



Interviews with teachers and on— site observation of classes 
indicated that they provided daily opportunities for discussion 
4-n French, in addition , the teachers did not discourage the 
children's use of their patois French. Activities were pro- 
vided daily for the the following percentage of time: 

December - 68% 

January - 88% 

February - 54% 

March - 65% 

April - 90% 

May - 69% 

Because the process was performed frequently, and product 
objective 1-3.1 was not accomplished, the possibility of a need 
for restructuring process objective 1-3. IP is evidenced. The 
evaluators recommend that this type of restructuring occur. 

Since the corresponding product objective seems to be such an 
important one for a bilingual program, the project staff should 
work on the means for accomplishing this objective. As suggested 
by the project staff, the status of product arid process objective 
1-3.1 and 1-3. IP reflects the need for a French specialist to 
structure French instruction. 

Objective 1-3.2 : 

Students will demonstrate standard expression and 
pronounciation. At the end of the year the teacher 
will ask questions with standard response patterns 
as noted by teacher ratings and observer checklists. 
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Evaluation: 
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This objective was measured by presenting the student with 
a series of ten commands in standard French. The student was 
expected to respond to the command with the appropriate action. 
In order for the objective to be accomplished, all students were 
required to respond to all commands correctly. Table 104 sum- 
marizes the t-test for correlated data used to compare pre-test 
and post-test scores. 



Table 104 

instructional Objective 1-3.2 
N, X, SD, % at Criterion and t-ratio 



f 




N= 19 


» 


\\. 




Pre 


Post 


? 

t - '" 


X 


6.8421 


8.2631 


| 


SD 


1.5308 


1.0685 


► ■' 
v: 

t 

i* ; 


% at 


Criterion 0 


13 




Difference 
Between Means 


1.4210 


i’i . 

iv:' 


t; 




df 


18 


g 




t 


4.0266* 


,v- 









* <.001 

Table 104 indicates that a highly significant difference 
at the .001 level existed between the pre-test and post-test 
scores. Yet, neither on the pre-test nor on the post-test did 
the 100% of the students required by the objective accomplish 
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the objective. Only 13% of the students accomplished the 
objective on the post-test. Participation in the program seems 
to have had some effect, however, on the students' ability to 
demonstrate standard expression and pronounciation , as suggested 
by the significant difference between the two sets of scores. 

The evaluators recommend that a review of the criterion level 
specified in the objective be made to determine its appropriate- 
ness for the program, in light of the fact that a significant 
gain occurred. Objective 1-3.2 was accomplished. 



Objective 1-3. 2P ; 



The audio- lingual method of presentation will be 
used. At the beginning of the year the teacher 
will administer orally to a sampling of the class 
questions which elicit non-standard response pat- 
terns. Drill will be provided to the class as a 
group, using choral, half -choral, and individual 
response patterns. Children needing additional 
drill will utilize the language master, using 
response cards prepared by the project director. 
The activities will be recorded in a lesson plan 
book. 



Evaluation : 






Monitoring of first grade classrooms indicated that the 
audio-lingual method of presentation was used. At the begin- 
ning of the year the teachers administered questions which 

... ,-jt 

elicit non-standard response patterns. Drills involving 
full choral, half -choral, and individual response patterns 
were then used to practice standard French pronounciation 
and expression. Children requiring additional drills utilized 
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the Par Ions Francais Kit and teacher-made language master 



cards. Although no frequency of activity is specified in the 
process objective , a determination of the percentage of time 
in which process 1-3. 2P was performed at least once a week was 
made as follows: 

December - No record of process exists 
January - 82% 

February - 72% 

March - 91% 

April - 95% 

May - 61% 

The failure to accomplish product objective 1-3.2 sug- 
gests that either this frequency of performance of the pro- 
cess was not sufficient and should be drastically increased, 
or that the particular activities involved in the process 
were not appropriate. The evaluators suggest that a review 
of these two possibilities occur. 



Objective 1-3 . 3 : 



Students will show a statistically significant 
(p<.05) improvement in French vocabulary recog- 
nition, as noted by a French vocabulary test 
(either standardized or teacher-made) . 



Evaluation : 

Table 105 presents the analysis of data gathered from the 
assessment of the objective, a t-test for correlated data. 
Table 105 indicates that the students demonstrated a statisti- 



cally significant improvement in French vocabulary recognition, 
not at the .05 level, but at the .001 level. This statistic 
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Table 105 



^Instructional Objective 1-3.3 
N, X, SD, % at Criterion and t-ratio 



N= 27 





Pre 


Post 


X 


6.4074 


9.3703 


SD 


2.3295 


0.5935 



Difference 

Between Means 2.9629 

df 26 

t 7.8135* 



* <.001 



suggests that the program had a positive impact on the students' 
skills in French vocabulary recognition. Each student's abil- 
ity was measured by asking him to identify in French a series 
of ten objects. No criterion level was specified in this objec- 
tive. Objective 1-3.3 was accomplished. 



Objective 1-3. 3P : 



Vocabulary will be introduced within the frame- 
j work of classroom activites.> The classroom 

( teacher will prepare for each new vocabulary 

word a visual representation card. Peer teach- 
I ing will be used for drill followed by utiliza- 

i tion of the language master for students needing 

j additional drill. The activities will be re- 

; corded in the lesson plan book. 

i 
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Evaluation : 







Interviews with teacher and observation of first grade 
classrooms indicated that teachers introduced vocabulary 
within the framework of classroom activities. Visual repre- 
sentation cards were prepared for new words. In addition, 
language master cards, the Par Ions Francais Kit , and the 
Talking Dictionary Kit were used with students requiring 
additional drill. Although process l-3.3plloes not specify 

the frequency with which it is to be performed, a measure of 

.<*1 

those classes which performed it at least once a week indi- 
cated the following percentage of required time devoted to 
objective 1-3.3P: 

December - No record of process exists 
January - 76% 

February - 54% 

March - 91% 

April - 95% 

May - 62% 

Because product objective 1-3.3 was accomplished, it is 
reasonable to conclude that the processes used to accomplish 
it, that is, process objective 1-3. 3P, were appropriate. The 
evaluators recommend that this process be included intact in 
the project for the next program year. 



Objective 1-3.4 : 



First grade students will, learn to read simple 
sentences; presented any pages of basic French 
reading text, 20% of the students will be able 
to read the material orally with standard pro- 
nounciation, with no more than one error per 
line. This will be measured by teacher rating 
and observer checklist. 
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Evaluation : 



Due to an oversight on the part of the evaluation team, 
no determination of the status of this objective was made. 

Objective 1-3. 4P ; 

Reading process will be outlined by teachers 
during the summer . 

Evaluation: 



The reading process was not outlined during the summer 
of 1970 because of the late beginning of the Title VII pro- 
ject. Some attempts were made during the school year to 
outline the reading process. Interviews with teachers and 
other project staff, however, indicate the need for a spe- 
cialized person, an expert in French curriculum, to be 
involved in developing the reading process. The evaluators 
recommend that such a person be hired for inclusion on the 
project's staff for the next project year. 

Objective 1-4.1: 



j 50% of the monolingual English students will 

! show comprehension of simple classroom com- 

mands and procedures presented prally in 
l French by the teacher by their ability to 

perform those commands. This will be mea- 
sured by teacher rating and observer check- 
j list, 
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Evaluation : 



Students were measured on objective 1-4.1 as a post-test 
only. They were presented a series o£ four commands in French 
and were required to respond to those with appropriate actions. 
The highest possible score a child could obtain was four cor- 
rect; this score was required for accomplishment of the objec- 
tive. All four students tested received a perfect score on 
the measure. Therefore , objective 1-4.1 was accomplished. 

Objective 1-4 .IP; 



An audio-lingual approach will be used, coupled 
with the use of pattern drills programmed on 
cassettes and the language master. Activities 
will be carried out daily and recorded in the 
lesson plan book. 



Evaluation: 
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Monitoring of grade one classrooms for French instruc- 
tion indicated that an audio-lingual approach was used for 
teaching French vocabulary and commands in French. This 
approach was coupled with the employment of pattern drills 
progr amm ed on cassettes and the language master. The teachers 
provided appropriate exercises to be carried out daily for 
the following percentage of time: 

December - 50% 

January — 58% 

February - 54% 

March - 82% 

April - 85% 

May - 71% 
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Although teachers did not perform process 1-4. IP as fre- 
quently as was required by the process objective, their 
frequency of performing it seemed to be adequate as the c< res- 
ponding product objective 1-4.1 was accomplished. 

Objective 1-4 .2 : 

100% of the English speaking students will be 
able to sign at least three songs and play 
three sFrench games. This will be measured by 
teacher rating and observer checklist. 

Evaluation : 

The English children were instructed by the teacher or 
aide to sing a French song and play the corresponding game 
they had learned during the year . Students were considered 
as responding correctly if they sang the song and played the 
accompanying game of six out of six to accomplish objective 
1-4.2. No pre-test of this measure was made. The mean score 
received by the students was 3.75. Of the four students tested, 
no student accomplished the objective as specified; it should 
be noted that two of these students had a high absence record. 
Therefore, program objective 1-4.2 was not accomplished. 

Objective 1-4 .2P : 



Songs and games to be used will be collected by 
teachers during the summer. They will practice 
this activity at least once a week and record 
it in their lesson plan book. 
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Evaluation : 



Songs and games were not collected during the summer, 
but during the fall potato harvest vacation. Teachers pro- 
vided appropriate exercises for practicing French songs and 
games at least once a week for the following percentage of 
time: 



The fact the product objective 1-4.2 was not accomplished 
suggests that either the process used to accomplish it or the 
frequency of the process was not satisfactory. A review of the 
process indicates that not all teachers were singing French 
songs and playing French games at least once a week. The eval- 
uators feel tha'*; this explains the lack of accomplishment of 
product objective 1-4.2. The evaluators recommend that a more 
careful monitoring of the performance of process objective 
1-4. 2P be made for the next project year. 

Objective 1-4.3 : 

75% of the English speaking children will be 
able to identify orally 75% of the words on 
the French vocabulary list developed by tea- 
chers. Their abilities will be measured by 
observer checklist and teacher rating. 



i 
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April 

May 



December - 
January - 
February - 
March 



50% 

70% 

90% 

78% 

90% 

55% 
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Evaluation : 
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Only a post-test to assess this objective was administered 
to the students. The teacher presented the child with a series 
of pictures and required the child to identify the picture by 
stating its French name. The highest possible score a student 
could receive was ten correct. In order to accomplish the 
objective, students were required to answer eight items correctly. 
The mean score on this test was 8.400. One hundred percent of 
the students received a score of at least eight required by the 
objective. All five English students who were tested accomplished 
the objective; therefore, objective 1-4.3 was accomplished. 

Objective 1-4 .3P t 

Vocabulary will be introduced within the frame- 
work of classroom activities. The classroom 
teacher will prepare for each new vocabulary 
word a visual representation card. Peer teach- 
ing will be used for drill, followed by utiliza- 
tion of the language master for students needing 
additional drill. The activities will be re- 
corded in the lesson plan book. 

Evaluation t 

A monitoring of classroom procedures by the evaluator 
indicated that the teachers were introducing French voca- 
bulary within the framework of classroom activities. In 
addition, they prepared visual representation cards for 
new vocabulary words. Language master cards, the Par Ions 
Franca is Kit , and the Talking Dictionary Kit were employed 
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with students requiring additional drill. Although no 

frequency of process is specified in objective 1-4. 3P, 

a measure of those students who performed this process at 

least once a week was made; the following percentage of 

time was devoted to this process at stated: 

December - No record of . process exists 
January - 52% 

February - 45% 

March - 69% 

April - 80% 

May - 51% 

Although these frequencies seem to be rather low, the 
fact that -product objective 1-4.3 was accomplished indicates 
that the frequency of performing objective 1-4. 3P and the 
activities involved in this process were appropriate for teach- 
ing its corresponding product objective. 



Objective 1-5.1 ; 



100% of the English speaking students will be 
able to sing at least 3 French songs and play 
3 French games. This will be measured by 
teacher rating and observer checklist. 



Evaluation : 



The group of students tested for this objective were 
assessed by being required to sing three French songs and play 
three French games as directed by the teacher. Only a post- 
test with a possible score of six correct was administered. 
This randomly selected group of four students all earned the 
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perfect score of six required by the objective. Therefore, 
objective 1-5.2 was accomplished . 

Objective 1-5 . IP : 



Songs and games will be collected by teachers 
during the summer. They will practice this 
activity at least once a week and record it 
in their lesson plan book. 



Evaluation : 



Songs and games were not collected during the summer, but 
during the fall potato harvest vacation. Teachers provided 
appropriate exercises for practicing French songs and games at 
least once a week for the following percentage of time: 



December - 67% 
January - 64% 
February - 45% 
March - 65% 
April - 80% 
May - 52% 



The accomplishment of product objective 1—5.1 suggests 
that the corresponding process as described above was appro- 
priate . 



Objective 1-5 . 2 : 



90% of the children will be able to tell orally 
a story about a historical event or person re- 
lated to the Valley's history* This will be 
recorded and checked by teachers and evaluators 
on the checklist . 
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Evaluation: 




The teacher presented each child with a booklet entitled 
"Les Acadiens" and asked the child to tell her a story by read- 
ing the pictures. The students were required to describe ten 
of eighteen pictures correctly to satisfy the criterion. The 
test was administered only as a post-test. The mean score on 
this test was 12.000. Six of eight students* or 75% , who took 
the test accomplished the objective. Therefore, objective 1-5.2 
was not accomplished. 

Objective 1-5. 2P ; 

Appropriate stories about people and events in 
Valley history will be collected by teachers and 
used in the classroom on dates that cure on or 
near significant dates for the event of person. 



Evaluation : 



A booklet entitled "Les Acadiens" was published by the mat- 
erials development team during the winter, 1971. Until that 
time, no effort was directed at performing process 1-5. 2P. Since 
that time the teachers presented appropriate stories about people 
and events in Valley history at least once a week for the follow- 
ing percentage of time: March - 4%, April - 30%, May - 16%. These 
small percentages explain the failure to accomplish product objec- 
tive 1-5.2. Since the appropriate material will be available 
for the next project year, it seems reasonable to conclude that 
product objective 1—5.2 should be accomplished at that time. The 
evaluators recommend, however, that a review of the process be 
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made to determine its appropriateness. If it is considered to be 
appropriate , a more structured use of appropriate stories should 
be considered so that product objective 1-5.2 will be accomplished 

Objective 1-5.3 1 

90% of the students will be able to identify from 
a picture at least three landmarks of the Valley 
area. This will be measured by teacher rating 
and observer checklist. 

Evaluation: 

The student was presented with a series of three pictures 
of historical landmarks in the Valley. They were required to 
identify each of the three landmarks correctly. A t-test for 
correlated data was used to compare the pre-test and post-test 
scores; this analysis is summarized in Table 106. 

Table 106 indicates that no student could identify all 
three landmarks on either the pre-test or the post-test. How- 
ever, the fact that a significant difference, one that could 
have occurred by change less than one time in 1 , 000 , existed 
between the pre-test and post-test scores, suggests that par- 
ticipation in the bilingual program had some impact on the 
students' knowledge of Valley landmarks. The evaluators 
recommend that a review of the criterion level specified in 
this objective be made. In addition, the evaluators suggest 
that each of the pictures used for the testing of objective 
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Table 106 



^Instructional Objective 1-5.3 
N, X, SD, % at Criterion and t-ratio 



N= 25 





Pre 


Post 


X 


0.0400 


2.0000 


SD 


0.1959 


0.0000 


% at Criterion 


0 


0 



Difference 

Between Means 1.9600 

df 24 

t 10.0051* 



* <.001 



1-5.3 be examined for their clarity and for their commonness 
as landmarks in the Valley area. Objective 1-5.3 was not 
accomplished . 



Objective 1-5. 3P : 



Teachers will collect pictures of Valley land 
marks, e.g. buildings or significant natural 
resources, and describe them to the children 
and their importance. These activities will 
be recorded in the lesson plan book. 
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Evaluation : 

« f ■ 

No pictures were collected of Valley landmarks; therefore* 
process objective 1-5 *3P was not accomplished as specified. In 
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April 5% of the teachers presented activities about Valley land- 
marks, and in May 9% of the teachers structured such activities. 

The fact that objective 1-5.3 was not accomplished indicates 
that this frequency of performing activities related to iden- 
tification of Valley landmarks was not sufficient. This process 
objective should be reviewed. If its corresponding product 
objective is included in the next program year, the evaluators 
suggest that the project staff monitor a more frequent intro- 
duction of pictures of Valley landmarks into the curriculum. 
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INSTRUCTIONAL COMPONENT: COMMENDATIONS AND RECOMMENDATIONS 

Commendations 



The data gathered about the accomplishment of the instruc- 
tional product and process objectives indicate to the evaluators 
that the project should be commended on the following outcomes 
of the instructional component: 

1. The accomplishment of a large number of product 
objectives. 

2. The general appropriateness of the process activities 
and frequency of performance as indicated by the accom- 
plishment of the corresponding product objectives. 

3. The excellent performance of the students on the 
standardized tests. 

j 

4. The high degree of readiness for grade one work 
demonstrated by the majority of kindergarten stu- 
dents on the Metropolitan Readiness Test . 

5. The excellent cooperation of the teachers in con- 
structing and administering the tests. | 



Recommendations 



The failure to accomplish a number of the product objectives 
of the Instructional Component suggests that some changes should 
be implemented in these activities. The evaluators recommend 
that the following activities be performed so that all product 
objectives of the Instructional Component will be accomplished 
in future programs: 

1. The cumbersome quality of the testing procedure used to 
assess the specific instructional product objectives 
recommends the need for restructuring of this measure- 
ment procedure . 
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2. Objectives which were accomplished at both the pre- 
testing and post-testing should be reviewed; they 
should either be eliminated from the program or 
the criterion level specified in the objective 
should be raised. 

3. The frequency of the processes directed toward 
objectives which were not accomplished during the 
program but which showed significant difference 
between pre and post performance of students should 
be increased. 

4. The process directed toward those objectives 
which were not accomplished and for which no 
significant difference existed in student per- 
formance between pre- and post-testing should 
be reviewed; changing the specific process 
activities or increasing the frequency of their 
performance should be considered and implemented. 

5. A reconsideration of the appropriateness of some 
of the standardized tests for administration to 
students in kindergarten and grade one should be 
made, and appropriate revisions in the program 
implemented. 

6. A documentation of the particular process activities 
directed toward all product objectives should be made 
by the teachers and placed in the project files. 

7. A review should be made of the frequency of process 
specified in all process objectives; revisions of the 
frequency stated should be made based on data gathered 
during the 1970-71 evaluation. 

8. More effort should be directed toward teaching French 
in the classrooms. 
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STAFF DEVELOPMENT COMPONENT: EVALUATION OF SPECIFIC OBJECTIVES 



Objective SD-1 . 1 : 



The director will display an openness and willing- 
ness to work with others in the project and produce 
educational change as measured by an average rat- 
ing of three or higher on a five point rating given 
by the other project members, community, consul- 
tants, and administration. 



Evaluation : 




A questionnaire was distributed to a sample of project 
members , community members , consultants , and members of the 
local school districts' administrations. Table 107 summarizes 
the results of the questionnaire. 

As shown in Table 107, on nine of the ten qualities, 100% 
of the respondents assigned a rating of three or better to the 
project director. On the quality "considers suggestions offered 
by others" a small percentage, 14%, assigned a rating of two. 
Although this rating does not prevent the objective from being 
achieved, it does suggest an area of improvement for the pro- 
ject director. The project director should be commended on the 
highly positive ratings he received from members of the commun- 
ity and project staff. Objective SD— 1.1 has been accomplished. 
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Table 107 







Rating of Project Director's Openness and 
Willingness to Work with Others in the Project 



Personality Trait % Response of Rating 







1 


2 


3 


4 


5 


1, 


listens to new ideas 


0 


0 


14 


57 


29 


2. 


willingness to work 
with others 


0 


0 


0 


57 


43 


3. 


open to educational 
change 


0 


0 


0 


0 


100 


4. 


tries educational 
innovations 


0 


0 


0 


15 


85 


5. 


flexible in project 
direction 


0 


0 


29 


29 


42 


6. 


easy to work with 


0 


0 


14 


28 


58 


7. 


accessible to hear 
problems 


0 


0 


0 


28 


58 


8. 


considers suggestions 
offered by others 


0 


14 


14 


14 


58 


9. 


willing to initiate 
program change 


0 


0 


14 


14 


72 


10. 


accepts constructive 
criticism 


0 


0 


42 


29 


29 
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Objective SD-1 .IP : 

The project director will participate in a human 
relations laboratory. This led) should preferably 
I be a community development laboratory. 

i 

Evaluation : 

' / ; 

The project director did participate in a human relations 

laboratory during the summer of 1968. This four-week human 
development institute focused on group support, confidence 
build-up, conflict resolution, communication, and interpersonal 
staff development. The project director was one of 50 teachers 
and administrators who participated in the institute, which 
was directed by five trainers. Objective SD-1. IP has been com- 
pletely accomplished. 



Objective SD-1. 2 : 

The project director, executive committee, Title 3 
project director and the curriculum specialist will 
demonstrate an ability to work together in achieving 
the operational goals of the project, as measured 
by a majority Of favorable comments during inter- 
views and observer ratings. 



Evaluation: 




In order to measure objective SD-1. 2, a questionnaire was 
distributed to the executive committee of the project, the Title 
III project director, and the Title VII curriculum specialist. 

Four of the ten questionnaires were returned. In general, the 

/ 

four respondents were highly satisfied with the information they 
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had about the project and with the dissemination of information 
in the project. The four respondents all felt that they knew 
about project activities , were well informed about project eval- 
uation, and that positive lines of communication had been esta- 
blished. Similarly all four respondents indicated that they 
had confidence in the director's decisions, and felt that he 
had met up to their expectations. 

They all agreed that they had true insight into the finan- 
cial management of the project. A smaller number, three-fourths 
of the respondents, indicated that they were well informed about 
management of funds and classroom activities. These same three 
respondents also reported that they thought enough publicity 
was being given Title VII in their school district. Only two 
respondents, however, felt that the parents were well informed. 
Only one respondent felt that the Board of Directors meets often 
enough. These last two responses suggest the recommendation for 
the project: the project director should consider betters ways 
of informing the parents, if indeed this is still a problem; he 
should also examine the frequency of meetings with the Board of 
Directors to determine if it is sufficient. 

A subjective rating of the project director's ability to work 

¥ 

work with members of the executive committee, the Title III pro- 
ject director, and the curriculum specialist was made by the 
on-site project evaluator. He' recorded that the director was 
generally diplomatic with the people cited above, kept lines of 
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communication open at all times , and was highly cooperative with 
them. The responses on the questionnaire and the subjective 
ratings of the evaluator indicate that objective SD-1.2 has j 

been satisfied. ‘ 



Objective SD-1 .2P : 



A fellow of NTL will be employed to conduct a 
sensitivity laboratory for the executive com- 
mittee , the project director, the director of 
the ESEA 3 project, and the curriculum spe- 
cialist. Prior to this laboratory the NTL 
consultant will spend five days interviewing 
principals , teachers , and students . 
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Evaluation ; 

The NTL sensitivity lab was not held during the 1970-71 
school year because the project began too late to make arrange- 
ments for this lab . Therefore , the NTL consultant was not 
available for interviewing principals , teachers and students . 

An interview with the project director revealed that he still 
feels the need that for such a laboratory to be held for the 
executive committee and the curriculum specialist. He anti- 
cipates sending these individuals to such a lab during the 
following school year. Objective SD-1.2P was not accomplished. 
The evaluators recommend a review of its feasibility and pos- 
sible implementation for 1971-72 school year. It should be 
noted, however, that, although objective SD-1.2P was not accom- 
plished, the product objective SD-1.2 was accomplished. The 
actual relation of the process objective in this case to the 
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product objective should be investigated. Perhaps a different 
product objective should be structured to result from process 
SD-1.2P. 




Objective SD-1.3 : 

The director and his staff (principals and teachers) 
will demonstrate an ability to work together in 
achieving the operational goals of the project, as 
measured by the majority of favorable comments 
during interviews and observer ratings. 

Evaluation ; 

A questionnaire was constructed and distributed to 
members of the project staff to serve as the interviews for 
the measurement of objective SD _ 1.3. The responses of the 
project staff suggest their ability to work with the director 
in achieving the operational goals of the project. All of 
the teachers and principals who returned the questionnaire 
felt that the lines of communication had been opened between 
them and the project director. Similarly, all teachers 
were satisfied with the number of visits to their school 
by the project director. They all agreed that the project 
director was providing support for the French language program 
in their school. 

Mixed ratings about the director's fairness and openness, 
however, occurred. Sixty percent of the teachers felt that the 
director was open to suggestions, while 40% indicated that he 
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was not. Similarly, 60% of the teachers felt the director was 
fair in dealing with them, while 40% felt he was not. Eighty 
percent of the teachers, a slightly larger percentage, indicated 
that the director had furnished them with the materials he 
promised them. All of the respondents agreed that the director 
was following the project objectives; yet 73% of the teachers 
indicated that they had not been consulted to satisfactory degree 
concerning the purchase of materials required in their school. 

The subjective views of the on-site evaluator based on his 
observations of the program operation supported the responses 
of the teachers. He indicated that the project director seemed 
to be open to suggestions by the project staff and principals of 
the schools. He also indicated that the lines of communication 
between these personnel had been opened. He stated that the 
project director was generally following the goals and objectives 

of the Title VII project and that he often consulted the teachers 

* «• : 

and principals about the materials required by the system. The 
on-site evaluator, however, did not feel that the project director 
visited some school systenfs, especially SAD #24, as frequently 
as he should. 



The highly positive rating of the director by the project 
staff, in which at least 50% of the teachers rated him positively 
on each dimension of the scale, and the positive rating by the 

on-site evaluator of his actions and his ability to work with 
the project staff suggest that objective SD-1.3 has been accom- 
plished. The evaluators do recommend, however, that the project 
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director consider making more frequent and regular visits to 
the various school districts, especially SAD #24. 

Objective SD-1 ,3P ; ^ 

During the fall vacation a needs assessment and 
staff involvement workshop, which includes the 
principals, staff and aides in the program will 
be held. 

Evaluation ; 

A needs assessment and staff involvement workshop was held j 

on October 5 - 9, 1970. A description of the workshop and a list 
of participants are included in the director's log; thirteen 
teachers, ten teacher aides, and five principals participated in 
the workshop. The purpose of the workshop was to increase the 
self-knowledge of the participants, to inform them of the indi- 
viduality of the human being, to teach them about competition and 
cooperation, and to familarize them with innovative curriculum. 

A questionnaire was distributed to the workshop participants 
in order to obtain their reactions to it. The majority of 

I 

reactions to all aspects of the workshop were positive. Eighty- 
seven percent of the teachers felt the workshop time was used 
efficiently. The same percentage was satisfied with the con- 
sultants and felt that the workshop was well planned. Ninety 
percent of the participants responded that as a result of the j 

workshop they were better prepared to defend. Title VII; this also 
suggests that at the end of the workshop they better understood 

i 
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the goals and purposes of Title VII. Similarly, 93% of the 
participants indicated that the workshop prepared them better 
to teach the Instructional Component. The majority of parti- 
cipants, 70%, indicated that they enjoyed the third day of the 
workshop the most. Suggestions for changes in the workshop 
were highly individual and are recorded in the project files. 

In addition to the teachers ' favorable responses to the 
workshop, its value also seems to be in its contributions to the 
achievement of product objective SD-1.3. It is quite possible 
that because objective 1.3P was satisfied, objective 1.3 was 
satisfied. Objective SD-1.3P has been satisfied. Because of the 
highly positive response to it and because of its contribution 
to the achievement of the corresponding product objective, the 
evaluators recommend the consideration of including such a work- 
shop in the program for the 1971-72 year for new teachers, aides 
and other participants who are new to the program. 

Objective SD-2 . 1 : 

The teachers will demonstrate an increased 
skill in teaching English as a second lan- 
guage, as measured by a statistically sig- 
nificant increase in raw score from pre- to 
post-tests on an achievement test construc- 
ted by the in-service course instructors , as 
well as improved ratings on classroom perfor- 
mance as measured by observer checklist using 
expert observers. 
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Evaluation: 



Because of the late start of the St. John Valley Bilingual 
Program, the focus of the in-service program was on the develop- 
ment of French instruction, rather than on English as a second 
language instruction. Therefore, objective SD-2.1 has not been 
met. The evaluators recommend that this objective be included 
in the staff development component for the 1971-72 year, as 
English as a second language instruction is a vital part of 
the bilingual program. 

Objective SD-2 . IP : 

Pre-service and in-service courses in teaching 
English as a second language will be provided 
using expert instructors. Teachers will 
maintain 90% attendance at the courses . 

Evaluation : 

Because of the late start of the program, objective SD- 
2. IP was not performed. Plans for the 1971-72 year include the 
structuring of such pre-service and in-service courses. The 
evaluators consider this an essential part of the program and 
feel that it should be included for the next year. 



Objective SD-3 . 1 : 



The teachers will demonstrate an increased skill 
in teaching French as a first language, as meas- 
ured by a statistically significant increase in 
raw score from pre- to post-tests on an achieve- 
ment test constructed by the in-service cpurse . 
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instructor, as well as improved ratings on class- 
room performance as measured by observer check- 
list using expert observers. 



Evaluation : 

Due to an evaluative error , no achievement pre-test or 
post-test was. administered to measure objective SD-3.1. How- 
ever, an observer checklist was used to rate teachers' skills 
in teaching ESL. This checklist was constructed by the program 
staff in conjunction with Dr. Norman Dube who was in charge of 
the in-service course. A description of these ratings is pre- 
sented in Table 108. 



Teachers were rated on a pre and post basis on the following 
qualities: fluency in French, interaction with students, process 

of interaction, awareness of dialect, acceptance of student lan- 
guage, and reinforcing of positive attitudes. In general, very 
little change in rating from pre to post occurred. Teachers 
were rating on a five point scale, with 5 referring to "excel- 
lent" and 1 to "poor." No change in rating of the teachers in 
fluency of French occurred from the pre- to post-test. Teachers 
were rated on the pre-test on their interaction with students 
and processes of interaction, but for the post-test this was deter- 
mined by the course instructor to be non-applicable . The teacher 
showed a slight improvement in their awareness of dialogue, as 
more teachers were rated as "good" on the post-test than on the 
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pre-test; 10% of the teachers were rated at "excellent" on the 

/ 

post-test, while no one was rated as "excellent" on the pre-test. 

Similarly, a slight improvement occurred in their accept- 
ance of student language from the pre- to post-test. • The same 
percentage of teachers were rated as "excellent" on both tests, 
but on the post-test 20% more teachers were rated as "good" than 
on the pre-test. A slight improvement in their reinforcement 
of positive attitudes also occurred from the pre-test to the 
post-test. Although the same percentage of teachers were rated 
as "excellent" on both tests, 15% more teachers were rated as 
"good" on the post-test, than on the pre-test; no teacher was 
rated as "fair" on the post-test. Objective SD-3.1 seems to 
have been accomplished, although its measurement was somewhat 
limited . 
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Objective SD-3.1P : 

Pre-service and in-service courses in teaching 
French as a first language will be provided using 
expert instructors. Teachers will maintain 90% 
attendance at the courses. 

Evaluation ; 

No pre-service course in teaching French as a first 
language was held. An in-service in teaching French as a 
first language was held for Title VII personnel. The course 
title was "Language Learning and the Dialectical speaker in 
the Elementary School (Practicum) . " All program teachers were 
encouraged to attend. A record of the attendance indicated 
that the teachers maintained 94% attendance at the courses. 

Since 93% is greater than the 90% required by the objective, 
this aspect of the objective was achieved. 

SD-3.1P was accomplished to some extent. Because of the 
late start; of the program, no pre-service instruction in teach- 
ing French as a first language was held, although in-service 
instruction was conducted, and appropriate attendance main- 
tained. 

Objective SD-4 .1 : 

100% of the teachers will achieve at the cri- 
terion level established for the test at the 
end of Preparing Instr uctional Objectives 
(Mager, R.F. ) 
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Evaluation: 




Eleven program teachers completed the test at the end of 
Preparing Instructional Objectives on January 30 , 1971. All 
teachers received scores between 20 and 40. The criterion 
level established for the tests is 37 of 44 items correct. 

Only one of the eleven teachers received a score of 37 or better; 
this teacher scored 40 correct. Therefore, only one teacher, or 
9% of the teachers, achieved the criterion level. 

Objective SD-4.1 has not been accomplished. Because of 
the importance of understanding the concepts and mechanics of 
behavioral objectives, the evaluators suggest that the program 
focus on achievement of objective SD-4.1 during the next program 
year . 

Objective SD-4 . IP : 

Mager's test will be provided to teachers and 

assigned to be completed during the pre-service j 

session. 

Evaluation : 

Mager's test was provided to the teachers and assigned to ? 

them, not during the pre-service session, but on January 30, 1971. \ 

All teachers but one received the test that day; this teacher J 

■ji 

did not. complete it because she did not attend the workshop that $ 

i 

day. | 




The appropriateness of objective SD-4.1P for achieving 
objective SD-4.1 is questionable. Although Mager's test was 
provided to the teachers, it is unclear whether they were re- 
sponsible for reading the textbook - . This task would be-*essen— 
tial for them to complete the test successfully, if they did 
read it, the information included in the text does not seem to 
be; sufficient for their answering the questions in the final 
test. ' 



The evaluators suggest that some other type of presenta— 
tion of the concept of behavioral objectives be used, such as 
the Vimcet materials. The program staff has informed the eval- 
uator; that the Vimcet filpstrips will be 1 used during 1971-72. 
This process was not used this year because the tight scheduling 
of the project and its late beginning limited the .amount of time 

, c 

which could be devoted to this objective. Objective SD-4.1P 
was partially completed , because one teacher did not receive a 



copy of Mager's te$t, and, therefo re, d id not complete it. 



Objective SD-5 . 1 : 



Teacher^ a ides will contribute significantly to 
the classroom operations, by assisting the 
teacher with clericial and managerial matters, 
with the operation of equipment, with obser- 
vation and testing of the pupils. The majority 
°f aides will receive positive ratings. Their 
abilities will be measured by teacher ratings 
and observer checklists. 



\ 
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Evaluation ; . 

• /> ' 
ry 

The project director, rather than, -the project teachers, 
rated each teacher aide on a five point scale, with 5 repre- 
senting a rating’ of "excellent" and 1 representing a rating 
of "poor." These ratings are summarized in Table 1(19. 

. . *j 

The results shown in Table 109 indicate that for seven 

of eight duties all aides received a rating of "good," "very 

good," or "excellent." For the eighth duty, the aide "uses a 
- / . • * • ’ 
basic academic ..French when interacting with students," 40% 

of the aides received only a rating, of "fair." Since this 

/ \ 

checklist was constructed by the program's staff, it seems 

that the performance/ of the aides of quality number eight was 

/ ^ ’ .. • 

important. Therefore, an emphasis should b§ placed on encourag- 
ing the aides to use basic academic French when interacting with 

' r ' 

V • ■ • • 

■ students . The^evaluators suggest that the project staff inves- 
tigate some specific activities for structuring such a use of 

French in the classroom. Objective SD-5.1 has been accomplished 

/ r" 

and measured through the use of an observer checklist. On-site 
observation by the project evaluator confirmed the results of 
this checklist,. • 

. j. * 
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Table 109 



Rating of Teacher Aides' Performance by Project Director 



• 




Duty 




% 


Rating 


- 




• 


- 


5 


4 


3 


2 


1 *_ 




1. 


Assists teacher in j 
collection of materials 
and supplies. 


0 


90 


10 


0 


0 




2. 


Records objectives being 
met on checklist. 


0 


30 


70 


0 


0 


- . , 


3. 


Does follow-up instruc- 
tion with needy students. 


10 


50 


40 


0 


0 


1 


4. 

i 


Works with instructional 
equipment for individual 
needs. 


10 


80 


10 


0 


0 / 




5. 


Assists t eac her in pre- 
paring materials for class. 


10 


70 


20 


•0 


0 ' 


V 


6. 


Is pleasant and positive 
with children. 


10 


20 


70 


0 


0 




7. 

.. / 


Communicates openly with 
children. 


10 


20 


70 


0 


0 




8. 


Uses a basic academic 
French when interacting 
with students. 


10 


0 


50 


40 


0 



* 5-Excellent» 4-Very Good, 3-Good, 2-Fair, 1-Poor. 
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Objective SD-5 . IP : 

. : ^ .. 

Aides will participate in; pre- service courses 
designed to impart the necessary clerical , 

— • — managerial and technical skill . 

•"* Evaluation: » 



No pre-service was held for the aides; the Title VII 
staff did not deem such a course necessary because the teacher 
aides had already been enrolled in courses designed to meet 
these needs. The highly positive ratings received by the aides 
in objective SD-5.1 confirm the judgment ^by the Title VII staff 
of the lack of need for this type of pre-service courses for; the 
teacher aides. Objective SD-5. IP was not met. The evaluators 
feel that justification for its not being met has been made by 
the project staff. . . ' 



/ 

Ob j ective SD-5 .2 : 

The majority of teacher aides will parti- 
y cipate in professional development courses. 

, ■" ' /" 

Evaluation : 




Eight of ten teacher aides attended such professional 
development courses. One. aide did not participate because 

i 

she was hired too late in the program to, do so. The second 
aide did not participate “because she had already completed 



the professional development courses. Teacher aides in Van 
Buren were enrolled in ED' 300 / entitled "Primary Curriculum/ 
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Methods, and Materials." Teacher aides in Madawaska and 
Prenchville completed CSTS which focused on the use of audio- 
n visual equipment in class. They attended all meetings and 
satisfied the ^attendance policies established by the Univer- 
sity of Maine for teacher aide certification in the State of. 

Maine. Objective SD-5.2 has been completed. 

, \ ■ 

\ - 

Objective SD-5.2P ; 

. \ 

Aides will be encouraged by project director 
and teachers, to attend professional development 
.courses. At\ least one meeting will be held at 
the beginning of each semester to discuss the 
courses. \ 

Evaluation: 



• Meetings were held with aides on October 6 f 1970 and 
January 30, 1971 to encourage their attendance at professional 
development courses. These meetings were conducted as part of 
various workshops, at which teacher aides were either given a 
syllabus or a verbal report of the available courses.. The 
teacher aides then expressed their views about the appro- 
priateness of the course and the possibility of their attending 
it. Because of the uniqueness of the three systems, courses 
were generally offered within each system rather than for the 
entire group of aides . The ^evaluator attended the meetings on 
October 6, 1970 and January 30, 1971 and confirmed that at 
these meetings the aides were encouraged to attend professional 
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\ 

development courses. The accomplishment of objective SD-5.2 
also suggests that the aides were encouraged to attend profes- 
sional development courses. Objective SD-5.2 has been accpm- 
plished. - * 
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STAFF DEVELOPMENT COMPONENT: ADDITIONAL DATA . 



Workshop Evaluations : 



v 



O 

ERIC 



At each workshop a questionnaire was distributed to 
its participants to determine their reactions to the work- 

4 

shop and obtain suggestions about improving the content an<j^ 
scheduling of the workshop for the next program year . The 
following narrative then, discusses the participants' re- 
actions to the workshops held during the 1970-71 program 



year for the St. John Valley .Bilingual Program. Each work- 

\ ' \ 

shop is discussed individually. 

V 

Workshop Held During Week of November 5, 1970 

The evaluation of . this workshop is included in the 
discussion of the evaluation of objective SD-1.1. / 



/ ’ 



Workshop of November 23/ 1970 




/, 



. This workshop focused on a discussion of Acadian Culture 
by .the anthropology instructor at the University of/Maine at 
Ft. Kent. The overall reaction of the teachers to/ this work- 
shop- was highly positive. Ninety-three percent ox the teachers 
responded * that the workshop time was used efficiently and that 
the instructor 1 s lecture was we 11 -organized. /An equally large 
majority stated tjiat reviewing the French materials and dis- 
cussing the French word exercises were beneficial. A similar 



291 




Workshop Visit by Dr. Lambert of February 11 - 13, 1971 

c ■ ' . *\ 

The results of the questionnaire completed about the visit, 
of Dr. Lambert to the St. John Valley Bilingual Program are sum- 
marized in Table 110 . 

The results shown in Table 110 demonstrate the positive -- 
support of the program teachers for the - generally accepted 
concepts of bilingual education. A majority of teacher, 60%, 
disagreed with- statement two, "The teacher should play the 
role of a monolingual at all times." This disagreement 
suggests the teachers ' support of the philosophy of the 

St. John Valley Bilingual Program. Similarly, their agree- 

' •/ * 

ment with statement five, with 96% agreeing, further reflects 
their support for the use of the local dialect in introducing 
French. The teachers, however, seemed divided on the issue of 



whether to switch from French or English in instruction, state- 

■ . \ • ? 

ment ten. Perhaps some future in-service courses might focus 
on the value of each of these approaches so that some type 
of guidelines or philosophy for the program could be esta- 
blished. 
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Workshop of April 3, 1971 

y* • y , 

This workshop focused on the process or methods of edu- 
cation in the classroom, with emphasis on the psychology of 
the disadvantaged learner . The workshop was. conducted by 
Dr. Nichols, a noted child psychologist at the University 
of Maine. The results of the questionnaire administered about 
this workshop are included in the project files. . 

Workshop of May 22, 1971 

This workshop was conducted by a representive of "Les' 

k 

Editions Francaises, Inc." A film on "Reading ^Development and 

■ • / 

Language" was shown. The teachers were asked to complete an 
open-ended question which requested them to identify the strong^ 
est point of the presentation in order to determine their 
reactions to this workshop presentation. In general, the tea- 

v 

chers and aides reacted highly positively to the workshop. Such 
comments as. "very interesting speaker, showed much understanding, 
of the children we deal with, which should be considered when 
presenting a speaker," and she "was probably the most. dynamic 
lecturer we have heard this year," reflect this positive reac- ■- 
tjion. The teachers were most impressed by the presenter's 
highly dynamic approach, her spontaneous approach to education, 
her presentation of the flexible classroom approach, and her 
ideas on teaching reading. 



■ N 
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Course EDM 280-Teaching French to l the Dialectual Speaker 

Participants in the course, "Teaching French to the 
Dialectical Speaker” were asked to complete a course cri- 
tique in ordler to determine the strengths and weaknesses of 

' ** • 

€he course. The overall reaction to the course was highly 

positive i ae participants unanimously agreed that the in- 

structor possessed the depth of knowledge in the course' con- 
tent required to teach it, that the classes had been well pre- 
pared, and that the instructor related the course to the actual 
classroom teaching situation. . Similarly, 93% agreed that the 
objectives of the course were clear; 92% felt that the objec- 
tives were appropriate for them. An equally large majority, 

92% of the participants, responded that the difficulty of the 
course" was appropriate, while 8% indicated that it was much 



to difficult for them. 



\ 



/ 



Seventy-six percent of the teachers responded that there 

was a sufficient supply of materials for the course. A large 

\ 

group of teachers 84%, also agreed that the class time was' 

c. 

being used efficiently, and 8 5% noted that the time alloted to 
work on classroom activities was used efficiently* Similarly, 
84% felt that enough time was spend discussing and participat- 
ing in French during the course. The majority of the group was 
satisfied with the organization of the course, as 68% indicated 
that enough small group discussions had been held. Of course, 

• . ' ’ ' 
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some' examination of whether additional small group discussions - 

✓ ' ' ' * 

could have been included should occur, as 32% felt that not 
enough small group discussions had been held during the course. 

The teachers replied that the addition of more demonstra- 
tions on classroom techniques would be a valuable asset to such 
a course,. Sixty-four percent of the teachers stated that the 
instructor had provided a sufficient number of such demonstra- 
tions, but more would be useful; 23% felt that more would not 
be useful; 8% indicated that not enough had been provided. For 
most participants the meeting time for the cours^ was convenient. 
For 85% of the teachers participation in the course had an impact 
on the way they looked at children in their class. Approximately 

one-half of the teachers said their command of the French lan- 

» ' . 

guage had improved since the beginning of the course; of these 

teachers, 90% attributed this improvement to group participation 

\ • 

in the course . Seventy percent of the teachers indicated that 
they were getting . enough feedback from the instructor on their 
written assignments. Similarly 75% noted that they learned 
about educational objective during the program. 

Staff Questionnaire About Program Operation 

During December a questionnaire was administered to the 
Title VII teachers to obtain their reactions to various aspects 
v pf the operation of the Title VII program in the St. John Valley. 
At that time 86% of the respondents felt that they had developed . 
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a bilingual curriculum in their classroom. Similarly, 80% 
responded that they had worked enough with French to determine 
the type of materials appropriate for French instruction and 
development. One major criticism of the program, by 50% of 
the teachers, was that they felt overworked as a result of 
Title VII. Thirty-three percent of the teachers reported that 
they did not have adequate time for planning during the school 
day. The evaluators recommend that an investigation of the 
criticisms be made and appropriate changes implemented. When 

N 

questioned about the testing procedures in the program, 86% of 
the teachers responded that they could foresee a positive value 
in pre-testing and post-testing for the program objectives; the 
large majority of teachers, 75%, responded that pre-testing 
should have been done, as it was, by the classroom teacher or* 
the aide. ^ 

The questionnaire also attempted to determine the reaction 
of the project teachers to the administrative personnel of the 
project, including the director, curriculum specialist, and 
evaluator. Although the large majority, 88%, of the Title VII 
teachers were not disappointed in any way^with the Title VII 
administrative staff, they did feel ill at ease when these 
administrative personnel entered the classroom. Eighty percent 
noted that they felt ill at ease when the director entered the 
classroom, 100% when the curriculum specialist entered the 
classroom, and 100% when the evaluator entered the classroom. 
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Repeated discussions and informal interviews with the program 

teachers after that time indicated that some improvement had 

* m 

> occurred in their ease with administrative personnel in the . 

•*> 

classroom. Yet the evaluators see this as a still existing 
\ problem which should be corrected during the next program year. 

The evaluators recommend that the administrative staff make 

\ 

a more directed effort to make the teachers feel more at ease 
when they enter the classrooms. 



/ 



A large majority of teachers agreed, however, that these 
- _ 'three administrative personnel visited the classroom often 

enough, although 12% indicated that the curriculum specialist 
could be in their classroom more often, and 25% responded that 
the project director could visit their classroom more frequently. 

* . -- 4 

No determination was-inajie if these criticism existed at the end 

of the project year; The evaluator recommends, therefore, that 
\ \ • • 

; the administrative staff poll the teachers at the beginning of 

the new program year to determine the frequency of visits by the 
! . • \ ( 

project administration they would Consider' appropriate; a 

schedule for visitations should then be constructed and main- 

tained. 
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STAFF DEVELOPMENT COMPONENT: COMMENDATIONS AND RECOMMENDATIONS 

• ^ 

I * 

Commendations 






Based on the data gathered about the staff development 
component, the evaluators commend the project on the following: 

1. The excellent working relationship between 
all members of the program staff. 

2. The excellent and well-received in-service 
program instituted by the project. 

3. The interest and enthusiasm of the teachers 

and other participants in the in-s.ervice program. 

4. The respect and enthusiasm commanded by the 
project director. 

5. The participation of the aides in professional 
development courses. 

6. The achievement by the project staff of the J 
large majority of objectives in this component. 

7. The positive attitude of the project teachers, 
teacher aides, and administrative staff toward 
the program. 



Recommendations : 



The evidence gathered about this program component suggests 
the need for ,the following changes and additions to the staff 
Development Component : " \ 

1. - The placement of additional emphasis on second 

language development among the teachers. 

2. The inclusion of pre-service or in-service instruc- 
tion in teaching English as a second language. 

3 . A greater involvement of teachers in curriculum 
development. 
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4. The introduction of more .structured instruction 

of teachers and aides about behavioral objectives , 
such -as use of the Vimcet materials. 

5. More coodination and cooperation between the 
teachers and the curriculum specialist. 

6. The scheduling of more frequent and more regular 
visits to program classrooms by the administrative 
staff. 

1 * *' 

\ 
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1 COMMUNITY COMPONENT: EVALUATION OF SPECIFIC OBJECTIVES 

Objective C -l . 1 : . * . - 




A community advisory group will be foriiTed b'y~ 
October, 1970. It will consist of French 
and English speaking community members (busi- 
nessmen, educators, parents, clergy and high 
school students) . There will be five members 
f from each community, each member approved by 
the school board. 

i , 



Evaluation: 



An advisory group was formed for each of the communities 
of . the St. John Valley Bilingual Program during the program 

x ... \ 

year. By October, 1970, the^deadline specified in the objec- 
tive, advisory groups had been formed in two of the communities 
SAD #33 and SAD #24. The Madawaska advisory committee was 

completed during February, 1971. Five members were selected 

\ 

from each community; each member was approved by the school 

. k « 

board. A1.1 nembers were bilingual in French and English. The 

advisory group for each community contained at least one 

representative from the following professions: businessmen, 

° . l 

educators, parents, clergy, and high school students. 



Although the activities cited in Objective C-l.l were com- 
pleted, the deadline of October# 1970 was not met because the 

*s C 

Madawaska Board of Directors did not select its entire adyisory 
council by that date. The evaluators recommend for td^ next 
program year that either the sam& members remain on the advisory 
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group or all members be selected by the beginning of the school 
year . 

Objective C-l .IP ; 

The community will be informed of the opportunity 
to participate on the advisory council by: 

1) letter and 2) director's personal contact. 

Evaluation : j 

The community was informed of the opportunity to partici- 
pate in the advisory council by letter and by direct personal 
contact. The formation of the advisory council group was 
initiated by the project director when he requested from each 
school board a list of advisory council members for their 

A - i 

school district at a meeting on September 17, 1970. The mem- 
bers had to meet the cr\tefia cited in objective C-l.l. 

Upon the receipt of . a list of names from each school 
board, the project director sent*-each selected community mem- 
ber a letter inviting him to participate in the advisory 
group. Such letters were sent to representatives in two of 
the school districts during the month of October and to those 
in the remaining school district by February, 1971. These let- 
ters informed the potential advisory group member of his recom- 
mendation to become a member of the group and his responsibilities 
as a member; it encouraged him to participate or to contact the 
project director if participation was impossible. 
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Objective C-1.1P was satisfied, although additional effort 
should have been made by the project management to encourage 
the formation of the Madawaska advisory group earlier than Feb- 
ruary, 1971. 

Objective C-l . 2 : 

The advisory group will make at least two sug- 
gestions that are accepted and incorporated 
into the ; program. The incorporations will be 
recorded in the director's log. 

Evaluation ' 

/ . . • .. 

/ 

The advisory council made three suggestions which were 
incorporated into the program. A^record of thesei suggestions 
and of the objectives to which they related was included in 
the project director's log. The first recommendation was that 
frequent information about the progress of\the project s should 
be presented to the community. This recommendation was accep- 
ted and incorporated into the, -program and was related toj objec- 
tive C-2.1 and C-2.2. The second suggestion, that the program 

* . -\ 

should publicize its activities and explain the role of the 

project to tile parents also related to objective C-2.1 and 
C-2.2; this suggestion was incorporated into the program. The 
third suggestion by the advisory council related to the instruc 
tional objective K-6.1, K-6.2, K-6/.3, 1-5.1, 1-5.2, and 1-5.3. 
This suggestion stated that the program should stress confi- 
dence and pride in the culture of the area. 

* \ ■ 

,3iG9 306 ’ , v 

t V * 



An examination of the objectives which related to these 
suggestions and their status at the end of the program indicate ■ 
that suggestions by the advisory council were indeed incorpor- 
ated into the program, and the objective relating to^these 
suggestions were satisfied. Objective C-1.2 was accomplished \ 

during the 1970*-7i-' program year. \ 

- \ 

\ 

\ 

Objective C-l ,2P \ 

\ 

The advisory council will meet at least monthly 
during the year. They will be encouraged by the 
staff to offer suggestions about the program. 

These suggestions will be recorded in the minutes. 

Evaluation: 



Advisory council meetings were held on the following dates : 
November 10, 1970, December 17, 1970, January 14, 1970, 

March 25, 1971, May 6, 1971, and June 12, 1971. The frequen- 
cies of these meetings did not satisfy the criterion established 
"in^the program objective C-.T.2P which specified meetings at 
leasts monthly . The remainder of jthe objective, however, was 
accomplished; suggestions were made by the advisory council 
members at each of these meetings, ' and these suggestions were' 
recorded in the minutes of the meeting. 



Objective C-1.2P has been partially accomplished. The 

evaluators recommend that monthly meetings be held during the 
next program year, and that additional suggestions for the 

program be elicited from the advisory group at those meetings. 
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Objective C-2 . 1 : 



At least one article per month concerning the 
bilingual program will appear in the French 
and English papers of the Valley. 



Evaluation : 



No articles about the bilingual program appeared in the 

\ 

French papers of the Valley 1 '. The project administration re- 



\>e2n 



ported that no articles had been published in French papers 

\ \ ' 

because the only\French papers in the area were Canadian. 
However, a bulletin en'titled "Project Brave Bulletin" was 



r - 



distributed monthly 'to the community, and especially to the 
parents of program participants. This bulletin described •, 
the activities of the program in both English and French and 
listed any new vocabulary \ words learned by the students during 
that month. A pamphlet about the project was also available 
for distribution. 



At least one article per month was published about the 
bilingual program in the English paper of the Valley, the St. 
John Valley Times , with the exception of the month of December. 
Generally, more than one article was /published each month. 
Articles appeared in the St . John Valley Times on the follow- 
ing dates: August 5> 197t), August 15, 1970, October 2, 1970, 

October 13, 1970, November 5, 1970 , January 14 , 1971, » 

March .4, 1971, April 15, 1971, and May 13 , 1971. Articles 

ff 

were also published in the - Bangor Daily News on the following 




S 
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dates: August 5, 1970, September 15 , 1970, September 30, 1970, 

\ , i ■ 

February 1, 1971, and June 3, 1971. 



Objective C-2.1 has beer, partially accomplished, although 
the dissemination of information which was implemented seemed 
quite adequate . 



Objective. C-2 . lp : 



The project director will arrange with newspapers 
to publish at least once article per month which 
the director and others may prepare. 



Evaluation: 



The project director arranged with the English newspapers 



\ to publish at least one 'article per. month. He spoke with the 



• St.. John Valley Timesx editor in November about the possibility 



\ 



of publishing monthly articles; the director received from the 
editor an assurance of fuSll cooperation. In addition, the 

publishing of articles in that newspaper prior to that dis- 

\ , . ' * 

cussion indicated the newspaper's willingness to cooperate. 



No arrangements were made for the publication of articles 

/ 

in the French newspaper of Edmunston, New Brunswick, Canada 
entitled "Le Madawaska." Instead of publishing articles in 
this newspaper, the project developed an informational pam- 
phlet for distribution to the community in order to increase 
the awareness and general information level about the project. 
The project also published a monthly news bulletin from January 
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to June which was distributed to parents , tochers, advisory * 

council members, the board o£ directors, and other bilingual 

projects; this bulletin emphasized the progress of the project 

through a discussion of the activities of the individuals par- 
' ^ 

ticipating in it. . 



Objective 02. IP was partially accomplished. The fact 

% V . * 

that no arrangements were made with the French newspapers 

' i 

explains the lack of publication of articles in such a news- 
paper for objective C-2.1. However, the extensive publicity 
given to the project through the use of monthly news bulletins 
and informational pamphlets and flyers about the projects eems 
to satisfactorily take the place of publishing articles in' a 

* • t 

French newspaper in Canada. j. 

# i *4 

Objective 02.2 : 



The project staff will participate in at least 
two radio and/or TV discussions about the biling- 
ual program. , 



Evaluation s 

Two television discussions and one radio discussion about 
the bilingual program were held during the project year 1970- 
71. The TV discussipn on September 30 , 1970 involved an 
interview of the project director on the Maine educational 

television station. The interview focused on the origin of 

/ ■ ■ 

the project, its location, its activities, and the anticipated 
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effects of the project. The TV program on November 18, 1970 

i 

included a presentation 'of a film of classroom procedures 
room activites , which demonstrated actual classroom procedures 
used to implement bilingualism in the classroom. Interviews 
were,, conducted with teachers and the project director of Title 
VII. 

The radio discussion was held on December 10, 1970; it 
was an informal discussion about the aims of Title VII and the 
procedures used to implement the goals of bilingualism in the 
St. John Valley. Objective C-2.2P was accomplished. More 
than two radio and television discussions about the bilingual 
program were held. 

Objective C-2 . 2P : 

The project director will arrange for staff 
members to participate in the discussions. 

This will be recorded in the director's log. 

Evaluation ; 

Arrangements were made for television and/or radio discus- 
sions through contact with various people on the television and 
radio stations. These contacts were initiated on September 30, 
1970. Further contacts were made on November 18, 1970 and 
December 10, 1970. Records of these arrangements- are included 

in the director ' s log. * The arrangements, were carried out as 

* 

planned, as indicated by the accomplishment of Objective C-2. 2. 

* . 

Objective C-2.2P has been accomplished. 

» X 
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Objective C-3.1 : 

At least 16 parents will volunteer as aides. 

Evaluation : 

Because of the late start of this program and the problems 
involved in initiating a new project, this aspect of the Com- 
munity Component was not performed. No parents volunteered as 
aides, because no attempt was made by the project to interest 
them in this type of participation. The evaluators recommend 
that this type of parent involvement be considered f or^ next 
year because it seems to be another excellent way of involving 
the community in the program. A discussion with the project 
director indicated that he has already considered including 
this objective in the 1971-72 program. Objective C-3.1 has not 
been accomplished. 

Objective C-3 .IP : 

Parents will be informed that they will par- 
ticipate as volunteer aides in the bilingual 
program 'through PTA meetings, letters from 
school, direct contact with parents. 

Evaluation : 

This objective was not accomplished. No attempt .was made 
to inform parents that they could participate as volunteer 
aides because such a program was not organized due to problems 
involved in initiating a first year program. Objective C-3. IP 
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should be the focus of attention for next year's Community Com- 
ponent. Objective C-3.1P has not been accomplished. 

'x 

Objective C-3 . 2 : 



1 



60% of the parents will visit the school at 
least twice a year . 



Evaluation 



Table 11 describes the parents' visitations. to the schools 
in the three districts during the 1970-71 school year. 

Table 111 

Frequency of Parent Visits to School 



X 



School of District 



Number of Visits — 
Cumulative Percent 





1 


2 


3 


4 


Frenchville 


90 


50 


— 


— 


Madawaska 


95 


90 


90 


— 


Van Buren 


70 


50 


4 0 


7 



The results shown in Table 111 indicate that at least 60% 
of the parents in each district visited at least once; in two 

of the three schools districts, however, 60% of the parents did 

/ . 

not visit, at least twice during the year, the criterion level 
established in the objective. It should be noted, however, 
that in one school district 40% of the parents visited three 
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tiroes, and 7% visited four times. In another school dis- 
trict 90% of the parents visited three times. 

Objective 03.2 w^s not accomplished. The evaluators 

recommend that an attempt should be made to structure more 

parents visits to the school during the next program year. 

% 

This is an excellent way to encourage parent participation in 

the program and to disseminate information about the project. 

% 

Objective C-3 . 2P ; 

* a 

Parents will be informed that they can visit 
the school to observe the program through 
PTA meetings, letters, direct contact with,, 
parents. 

- v 

Evaluation : 

Parents were informed in the monthly bulletin and by per- 
sonal letter from the project director that they could visit 
the project. Such invitations, however, were not issued until 
the fifth month of the program because until that time the pro- 
ject director did not feel that enough progress had taken place 

i 

in the classrooms to be a positive indication of the program's 
impact. After the fourth month of the program, when bilingual 
instruction in the classroom was succeeding, the parents were 
invited and encouraged to visit the schools. This late invi- 
tation of the parents to visit, the school may explain the lack 
of satisfaction of Objective C-3. 2. 
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The evaluators suggest that, because the next program year 
will not be the first year of program operation, the director 
take measures immediately at the beginning of the program to 
encourage parents' visits to the school to observe the program 
first hand and in that way t£ gain an understanding of it. The 
initiation of a parent aide program, which was - riot' implemented 
during this. year's program, will also encourage parent visits" 
to the school. 

Objective C-3.2P was accomplished during this year. Parents 
were informed that they could visit the school through monthly 
bulletins and letters. 

Objective C-3 . 3 ; 

At least 50% of the parents will, attend at 

least one meeting of the PTA group. 

Evaluation ; 

The percentage of parents listed below for each school 
attended at least one meeting of the PTA: Madawaska - meeting 

held at St. Thomas School on November 18, 1970 - 60%, meeting 
held at Evangaline School on November 23, 1970 - 90%; French- 
ville - meeting held at Bailey School on November 30, 1970 - 
55%; Van Buren - 70%. Objective C-3. 3 was Accomplished. The 
evaluators suggest that during the next program year attempts 
be made to attract additional parents to PTA meetings in each 

district and to attract parents to more than one meeting. 

/ ' • > 
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Objective C-3.3P : 



A PTA group will be formed in the fall. Parents , 

will be encouraged to join and actively parti- / 

cipate in meetings using various media. 

Evaluation ; 

A PTA group was formed in each of the school districts. 

The first meeting for the Madawaska group was in November, 1970; 
additional meetings were held in February, 1971 and April, 1971. 
The first meeting for SAD #33 was in November, 1970; other meet- 
ings were held in February, 1971 and March, 1971. No PTA exists 
in Van Buren, but a great deal of parent involvement occurs in 
the follow-through program existing in the St. John School. A 
record of attendance at meetings about this program was consid- 
ered attendance at a PTA meeting. 

Parents were informed they could participate in the PTA 
through letters, newspaper articles, and the community calendar 
on the local radio station. Through these media parents were 
also encouraged to join the PTA or to participate in the follow- 
through group and to actively attend meetings. The evaluators 
suggest that additional encouragement be provided during the 
next school year to increase participation by the parents in 
the PTA program. Objective C-3.3P was accomplished. 
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Objective C-4 .1; 



There will be a statistically significant increase 
(p<.05) in parents' enthusiasm about the bilingual 
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program from September to June, as measured by an 
attitude scale. \ 

Evaluation ; 

Tables 112 - 116 describe the responses of the parents 
to the attitude questionnaire about the program distributed 
to them „ in December, 1970. Because of the late administra- 
tion of the questionnaire, no post questionnaire was admin- 
istered in June. 

Objective C-4.1 was accomplished, as demonstrated by the 
highly positive attitudes reflected in the parents' responses 
to the questionnaire administered to them. 

Table 112 

"Are you pleased that your child 
is learning a second language?" 



District % Response 





Yes 


No 


Frenchville 


100 


0 


Madawaska 


98 


2 


Van Buren 


100 


0 


0 

Total — St. John Valley 


99 


1 



< 
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TABLE 113 



"How would you rate the Bilingual Program?" 



District % Response 





Excellent 


.Good 


Fair 


Poor 


Frenchville 


25 


x 


13 


6 


Madawaska/ 


51 


46 V 


3 


0 


Van Buren 


58 


34 


6 


0 


Total — St. John 










Valley 


50 


44 


5 


1 



/ . 

/ 

Table 114 

"Are you happy that your child is in 
the Bilingual Program?" 




ERIC 



District % Response 





Yes 


No 


Frenchville 


100 


0 


Madawaska 


100 


0 


' Van Buren 


97 


3 


Total — St. John Valley 

a • 


99 


1 
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Table 115 

"Do you think that your child is 
learning as much as he should in 
school this year?" 



District 


% Response 


- 


Yes 


No 


Prenchville • 


81 


19 . , 


Madawaska 


96 


4 


Van Buren 


97 


3 


Total — St. John Valley 


95 


5 


\ 

\ 

Table 116 






"Would you like your child to be in 
the Bilingual Program next year?" 




District 


% Response 


• 


Yes 


No 


. Frenchville 


88 


12 


Madawaska 


100 


0 


Van Buren 


97 


3 


Total — St. John Valley 


98 


2 




V 1 



7 
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Obj ective C-4 . IP ; 

See the objectives of the Community Component 
process objectives for producing this change 
in parental attitude. k 

Evaluation ; 

The evaluation of this process objective can be deter- 
mined by referring to the evaluations of all product and 
process objectives in this component and to the summary of 
the evaluation of the Community Component included in Part I 
of this report. 



Objective C-5 . 1 : 



The project director will invite the personnel 
from Ft. Kent State College to visit the program 
and begin participating in the development of 
the program. A formal relationship with Ft. Kent 
State College will be established by the end of 
the year. 



Evaluation ; 

Personnel from Ft. Kent State College were invited to visit 
and participate in the program. Th^se included Dr. Norman Dube, 
an in-service instructor, Mrs. Lowe^Ll Daigle, an in-service 
J instructor and member of the Board of Directors, Mr. Roger Paradis, 
a materials development consultant, and Dr. Roger Grindell. 

Dr. Dube and Mrs. Daigle visited the project by serving as in- 
service instructors in the teaching of French to Franco-Americans 
and Acadian Culture, respectively. 
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The relationship between the college and the project 
is highly positive, it involved mutual understanding between 
the two parties of the bilingual needs in the Valley. Letters 
in support of the project have been received from the staff 
of Ft. Kent state College; they have cooperated in providing 
training for the project staff. Objective p-5.1 has been 
accomplished . 

Objective C-5 .IP : 

In the fall the project director will approach 
Ft. Kent state College and /encourage their 
active participation with /the project. 

Evaluation : 

The following list cites the dates and descriptions of 
contracts between Ft. Kent College and the bilingual project; 
a record of these contacts is included in the director's log: 
November 3 f 1970 - Director met with chairman of academic 
affairs, Dr. Roger Grindell; November 10, 1970 - Director 
attended a faculty conference and discusses possible avenues 
the college could take in assisting the project in staff train- 
ing; January 21, 1971 - The director met with Mr. George Milner 
the director of C.E.D. in northern Maine; January. 22, 1971 - 
The director met with Dr. Norman Dube to finalize plans for 
the in-service course he would be instructing from February 
to June; March 19. 1971 - The director met with President Fox 
about the possibility of establishing a minor or major in 
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early childhood bilingual education; April 12 , 1971 - The pro 
ject director met with President Fox about the same topic 
discussed on March 19, 1971. 

Objective C-5.1P has been accomplished. This series of 
meetings indicates the outstanding cooperation and relation- 
ship between Ft. Kent State College and the St. John Valley 
Bilingual Project. Because Ft. Kent State College is the 
local higher education agency, the evaluators feel that such 
a liason is very positive and should be continued in future 
programs. 
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COMMUNITY COMPONENT : SOCIOLOGICAL DATA QUESTIONNAIRE RESPONSES . 

In order to determine the general characteristics of the 
population from which participants in the bilingual program were 
selected , a sociological data questionnaire was sent to each of 

ft 

the parents of students in the program. The questionnaire was 
written in both French and English in order to prevent language 
from becoming the reason for not completing the qiiestionnnaire. 
The following percentage of returns was obtained from the var- 
ious districts: Frenchville and St. Agatha Schools - 81%, 

Madawaska Schools - 78%, Van Buren Schools - 38%. The total 
number of questionnaires returned for all three districts was 
189. 

The following "discuss ion describes the sociological back- 
ground of the bilingual program participants . This section is 
meant only as a description; no conclusions about effectiveness 
of program or appropriateness of population should be drawn 

from this description. 

* 

Table 117 describes the number of years the parents have 
lived in the Valley. Table 117 indicates that the large ma^jOr- 
ity of parents have lived in the St. John Valley for at least 
five years , and many for more than ten years . A review of 
places where they lived prior to this time indicates that those 
who hacKmoved to the St. John Valley within the last five years 
lived in the United States, not in France or Canada, before 

326 ... 
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TABLE 117 

Parents' Number of Years Residence- 
in St. John Valley 



% of Respondents- 

School District Years Residence 



! 


0-1 


i-3 


3-5 


5-10 


10+ 


Frenchville and St. Agatha 


4 


4 


8 


.26 


28 


Madawaska 


6 


5 


5 


‘lO 


74 


van Buren 


0 


0 


7 


10 


83 


All Respondents 


4 


3 


6 


16 


71 



moving to the St. John Valley. Therefore, this is not a pop- 
ulation of recent immigrants ; it includes long-term residents 
of the St. John Valley and of the United States*. 



Table 118 indicates the urban or rural background of the 
parents of the bilingual participants. Table 118 shows that, 
for /the most part, at least three-fourths of the husbands 
and^wives came from rural backgrounds in their childhood and 
youthv Madawaska has the highest percentage of city-born 



dwellers , ""although even this percentage is not }iigh. 

\ ■ / 

. \ \ ■- • / . , 

A review of the ages of the parents whose children were in 



v 



/ 



the program indicates that for tne entire program, with 181 
women responding, 36% of these were under' 30; 37% were between 
ages 31 and 40; 27% were over age 40. The husbands seemed to be 
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TABLE 118 



Parents' Residence During Childhood and Youth 



School District . % in City and Country 



Wife Husband 





City 


Country 


City 


Country 


Frenchville and St. Agatha 


10 


90 


3 


97 


Madawaska 


28 


72 


. 40 


60 


Van Buren 


26 


74 


19 


81 


All Respondents 


20 


80 


20 


, > 

80 



slightly older than their wives. Of the 176 husbands whose ages 
were listed, 24% were under 30; 48% were between 31 and 40 years 
old? 28% w^re 41 or older. These parents cannot be characterized 
as being either very young or very old. Generally a distribution 
of ages exists.^ 



/ 





Table 119 presents a description of the schooling of the 
parents of the students in the Bilingual Program. Table ’119 
indicates that the largest group of parents completed twelve 

V , r 

years of schooling, or high school. Approximately 10% - 15% 
of the parents ^in each of the towns had educations beyond grade 
12. In general, the wives had less education than the husbands. 

A review of the occupations of the parents indicated that 
the majority of husbands served in one of the following 
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occupations: laborer, employee of Fraser Paper, farmer, semi- 

skilled worker, or professional, such as teacher. 

# Table 120 summarizes the wives' employment status. Table 

* 'x 

120 states that approximately 40% of the wives^ are currently 
employed in such occupations as beauticians, teachers, and hair- 
dressers. A small group, approximately one-fourth of the wives 

; , v 

who Responded, indicated that they had planned a career. Nrhis 

N \ 

response is interesting when compared to the larger percentage N 
currently employed. Many of the wives who are currently work- / 
ing , however , did not work a full week . Many were employed 'on 
a part time basis. 



TABLE 120 
Employment Status 





— 


School District 


. 

Wife's Status-% Respondents 



- 


Employed 


Planned 


a Career 




Yes 


No 


Yes 


No 


Frenchville and St. Agatha 


42 


58 


26 


74 


Madawaska 


38 


62 


24 


76 

i 


Van Buren 


38 


62 


30 


/ 

70/ \ 


Entire Program 


40 


60 


26 


74 
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Table 121 describes the size of families of program parti- 
cipants. Table 121 shows that the large majority of families 
had five or fewer children; approximatley one-fourth of the fam- 
ilies had more than five children, although, naturally, the per- 
centage of respondents decreased as the number of children 
increased. 

TABLE 121 

Size of Program Families~Number of Children 



School 

District Number of Children - % Respondents 







1 


2 


3 


4 


5 


6 


7 


8 


9 


10 


11 


11+ 




Frenchville 

and 

St. Agatha 


3 


14 


24 


13 


19 


11 


5 


3 


1 


3 > 


0 


4 


- 


Madawaska 


3 


23 


24 


18 


15 


5 


2 


2 


3 


5 


0 


0 




Van Buren 


3 


13 


2<T 


17 


10 


0 


10 


13 


7 


7 


0 


0 


r 


Entire 
Program 1 


3 


18 


24 


12 


16 


7 


6 


4 


3 


4 


0 


3 



The sociological data questionnnaire also included a series 
of questions to determine the language backgrQtfricE^of the parti- 
cipants in the bilingual program. Ninety-two percent of the 

/ 

wives and 95% of the husbands indicated that they could , speak a 
language other than English. Generally this second language was 
French, with perhaps one or maybe two exceptions. 
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Tables 122 



124 define the language background of the 
bilingual participants. Table 122 indicates that between 90% 

r . 

and 97% of the wives in each of the three districts and between 

L' 

94% and 97% of the husbands in the three districts speak French, 
- although a significantly smaller group, approximately one-third 
of the respondents, indicated that the wife conversed with her 

husband in French. Of these, approximately the same percen- 
r . • ■ t ' ■ 

tage conversed with their husband at home, and a slightly smal- 
ler percentage used French to converse with their husband 
outside the home. 

TABLE 122 

Percentage of Parents Who Speak French 



Schdol District 




% 


Respondents 






Wife 


Husband 


Wife 


Converses 

Husband 


with 










At Home Outside 


Frenchville and St. Agatha 


97 


97 


39 


33 


24 


Madawaska 


94 


94 


37 


31 


26 


Van Buren 


90 


94 


31 


. 34 


29 


Entire Program 


94 


95 


31 


44 


21 



Table 123 notes that between 83% and -87% of the respondents 
had children who understood thpm when they spoke French . A 

' V # 

smaller percentage, between 67% and 82%, indicated 7 that they had 



children who spoke to them in French. However, a larger percen 
tage of the children spoke to their parents in French when they 
were little. These percentages indicate the background of many 
of the program participants in the area of French langua/e. 

Y 

TABLE 123 

\ 

Percentage of Children Who Speak\ or urijjierstand French 





School District 


% Respondents 


Q 



0 


Understand 

Parents 


Speak to 
Parents 


Spoke when 
little 


Frenchville and St. Agatha 


87 


82 


93 


Madawaska 


83 


67 


78 


Van Buren 


84 


<'69 


86 


Entire Program 


84 


74 


85 



Table 124 gives some insight into the background in French * 

V, 

of the parents. This table states the almost all respondents 
had parents who spoke French in the home. Madawaska seems to 
have the lowest concentration of French speaking, but even its 
88% is high. Tables 122 - 124 indicates the significant presence 

V " 

of French language in the background of the program participants 
and their parents. 

t- , 

The sociological data questionnaire also attempted to define 

the reaction of the parents to the community. This involved a 

/ ' . ' v 
/ • 

/ 

,/ • 
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determination of their participation in their community and their 
identification of problems in the community. Of the parents who 
responded to the questionnaire in the three districts combined, 
only 6% said that they were a past or pr.esent'of f icer of the 
PTA; 70% indicated an interest in the PTA by saying they attended 
most, if not all PTA meetings .-^A smaller percentage, 24% said 
they belong to the PTA, but attended a few meetings .^^Jhe-'fact that 
three-fourths of the parents either^erejpf-fidersin the PTA, or 

attended most of the mee^ing^-r-^Iggests an interest in the school 

^ * 

by the communrty-r--^'^ 

/ 

Tables 125 and 126 cite the problems of the community identi- 
fied by the parents. Table 125 shows the parents' ratings of the 
series of problems which may exist in the community. Parents 
were to order the problems from 1 to 6 , from most to least serious 
respectively. Table 126 indicates the percent of parents which 
rated each of the six problems as the most serious . Tables 125 
and 126 indicate that the majority of parents saw jobs as the 
most serious problem in their community. The second most ser- 
ious problem seemed to be medical problems. Education problems 
ranked below these two problems and were considered much less 
severe than job or medical problems. 

The parents were asked to identify important goals in life 
for their sons and for their daughters. . Table 127 indicates the 
amount of education the parents feel youth should have today.. 

It reports that a large percentage of respondents felt that 

) 
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TABLE 125 



■ 

Problems of Communities as Seen by Parents 







Problem 


Degree of Severity - % Respondents 



. ' 


(Most) 1 


2 


3 


4 


5 


6 (least) 


Housing 


5 


17 


35 


20 


12 


11 


Medical 


25 


39 


14 


14 


4 


4 


Education 


10 


13 


18 


28 


24 


7 


Jobs 


67 


21' 


9 


1 


2 


0 


Transportation 


1 


3 


11 


19 


38 


28 


Community Spirit 


5 


7 


7 


13 


19 


49 




\ 
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TABLE 127 



Amount of Education Parents 

. 1 


Feel Youth Should Have 




Amount of Education 


% Respondents 



• 


Young Men 


Young Women 


6th grade or less 


0 


0 


Some high school 


1 


2 


Righ school education 
kigh school and 


12 


32 


. technical school 


27 


29 


College education 

4 


60 


37 



young men should have a college education. The parents were 
in almost unanimous agreement that the young men should have 
at least a high school education . The degree of ‘education 
they felt young wome& should have was slightly less. Only 37% 
of the parents felt that young women should have a college edu- 
cation, but they unanimously agreed that young women should 
have at . least a high school education. When questioned about 
their goals for their sons and their daughters, the most fre- 
quently mentioned were good education, good jobs, happiness, 
and health. 

Several questions required the parents to describe their 
attitude toward school and toward the bilingual program. 

Table 128 indicates that a larger percentage of parents either 
felt that the schools were doing an excellent job or a fair 
job. By fair, they seem to mean an adequate job. (Very few 
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TABLE 128 

Attitude Toward Job Done by Public Schools 



School District Quality of Job - % Respondents 



Frenchville and 


Excellent 


Good 


Fair 


Poor 


Very 

Poor 


St. Agatha 


36 


3 


54 


7 


0 


Madawaska 


51 


2 


40 


7 


0 


Van Buren 


45 


3 


52 f 


0 


0 


Entire Program 


43 . 


3 


48 


6 


0 



parents felt that the schools were doing a poor job; no parent 

/ 

felt that the were doing a very poor job. 

In order to. determine the parents' reaction to introducing 
a bilingual program into the schools , or at least to introducing 
French into the curriculum, the parents were asked whether they 
would like their children to learn some French as reported in 
Table 129. It is interesting to note, however, that as many 
as 12% of ^he parents in one district did not want their child . 
to learn some French. Yet, these students are involved in the 
bilingual program and are learning French. The implications of 
this response should be explored. Because this questionnaire 
was administered at the beginning of the year, the attitude of 
the parents toward learning French may have changed. Similarly, 
their familiarity with the program may have increased since the 
time of the administration of this questionnaire. 

O 

ERIC 






/ 

/ 



339 



336 



TABLE 129 

"Do you Think it Would be a Good Idea to 
Teach Your, Child Some French?" 







School District 


% Response 





. Yes 


No 


Frenchville and St. Agatha 


88 


12 


Madawaska 


89 


11 


Van Buren 


93 


7 


Entire Program 


89 


11 



Table 130 describes the familiarity of the parents with the 
Bilingual Program at the time this questionnnaire w'as adminis- 

, l 

tered. Table 130 suggests that the majority of respondents at 

') 

the time of the administration of this questionnaire yere only 
slightly familiar with the bilingual school program^ Evidence 
gathered later, which is included in the evaluation jot the Com- 
munity Component objectives, suggests that by theend of the 
school year the parents were much more familiar with the bilin- 
gual school program and supported it very highly* 
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TABLE 130 ' 

Familiarity of Parents with Bilingual School Program 







School District 


% Respondents 





Very 

: Familiar. 


Slightly 

Familiar 


Not . 
Familiar 


Frenchville and 
St. Agatha 


22 


< 

57 


21 *• 


Madawaska 


10 


62 


28 


Van Buren 


7 


■ 54 


39 . 


Entire Program 


15 


58 


27 
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COMMUNITY COMPONENT: COMMENDATIONS AND RECOMMENDATIONS 



Commendations 

& 



The data gathered to assess the Community Component 
of the St. John Valley Bilingual Project demonstrate the 
high degree of success the project had in obtaining the 
cooperation, understanding, and interest of the community 
in the project. The evaluators commend the project on the 





following aspects of its relationship with the community : 

1. The high degree of interest in the program 
shown by the large percentage of parents 
who visited the school and participated in 
the PTA. 

2. The extensive publicity given to the pro- 
gram through media of . television, radio, 
and English newspapers. 

3. Monthly bulletin publication and distribution 
of an informational pamphlet on the bilingbal 
program published by the curriculum coordinator. 

4. The excellent working relationship evi- 
denced between Ft. Kent State College and 
the St. John Valley Bilingual Project. 

5.. The incorporation of suggestions made by 
the advisory council into the bilingual 
program. 

6. The highly positive enthusiasm of the parents 
for the bilinjial program, as indicated by 
their responses to a questionnaire. 

7. The accomplishement of the majority of objec- 
tives in this component. 
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COMMUNITY COMPONENT: COMMENDATIONS . AND RECOMMENDATIONS 



Commendations 



The data gathered to assess the Community Component 
of the St. John Valley- Bilingual Project demonstrate the 
high degree of success the project had in obtaining the 
cooperation , understanding , and interest of the community 
in the project. The evaluators C 9 mmend*the project on the 
following aspects of its relationship with the community: 

1. The high degree of interest in the program • " - - 
shown by the largely percentage of parents 

who visited the school and participated in 
the PTA. 

2 . The extensive publicity given to the pro- 
gram through media of television, radio, 
and English newspapers. 

3. Monthly bulletin publication and distribution 
of an informational pamphlet on the bilingual 
program published by the. curriculum coordinator. 

, 4. The excellent working relationship /evi- 

denced between Ft. Kent State College and 
the St. John Valley Bilingual Project. 

5. The incorporation of suggestions made by 
the advisory council into the bilingual 
program. 

. J 

6. The highly positive enthusiasm of the parents 
for the bilingual program, as indicated by....: — 
their responses to a questionnaire. 

7. The accomplishement of the majority of objec- 

^ tives in this; component. 
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Recommendations 



Although the <ma jority of objectives of the Community 
Component were achieved , the following recommendations were 
suggested by the data : 

1. An emphasis should be placed on formulation 
and implementation of a parent volunteer aide 
program in the schools. 

2 . The parents should be encouraged to attend 
additional PTA meetings. 

3. The advisory council should be encouraged 
to make additional suggestions about the 
program? these suggestions should be incor- 

t porated into the program. 

j. V 

4. The advisory council meetings should be held 
at least-monthly . 

5. The relationship between the project and 
Ft. Kent State College should be continued. 

6. The, institution of adult education courses 
for parents which would focus on second lan- 
guage instruction or on instruction in other 
academic areas related to the bilingual edu- 
cation project should be considered. 



/ 
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MATERIALS DEVELOPMENT COMPONENT: 

EVALUATION OF SPECIFIC OBJECTIVES 

Objective MD-1.1 : 

The director and curriculum specialist will 
establish a working relationship with the 
Title 3 project, by collecting some of their 
materials and meeting with the director at 
least once a month. 

, \ 

Evaluation : 

The director and curriculum specialist established some 
type of relationship with the Title III Project staff. They 
collected books from the Title III project and held a series 
of meetings with the Title III director on the following dates: 
September 18 ,1970, November 2, 1970, December 10, 1970, and 
June 5, 1971. Both the director and curriculum specialist 
were present at two of these meetings, while only the director 
was present at two of these meetings . 



Objective MD-1.1 was partically accomplished. Although 
some materials were gathered and a working relationship was 
established with Title III, the Title VII director and curric- 
ulum specialist did not meet with the Title III project director 
at least once a month. The evaluators feel, however, that the 
extent of this relationship was satisfactory, and that additional 
meetings between the three people were not necessary. 



O 
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Objective MD-1. IP : 



The project director and Title III director will 
meet during the fall to discuss their respective 
programs. The project director will initiate the 
contact . 



Evaluation : 

The project director set up a meeting with the Title III 
director in the fall of 1970; this meeting was held on Sep- 
tember 18 , 1970. At the meeting the director and the Title 
III director discussed the roles of Title III and Title VII 
and possible cooperation between the two projects in such 
areas as materials development and development of classroom 
instructional techiniques. 

Objective MD-1. IP was accomplished. The project director 
and Title III director met during the fall to discuss their 
respective programs. The partial accomplishment of objective 
MD-1.1 further confirms the satisfactory accomplishment of 
MD-1. IP. 

Objective MD-1 . 2 : 



The curriculum specialist will collect materials 
from one follow-through project dealing with 
French speaking children in the state. 



Evaluation 

A report from the project director indicated that no 
materials were collected from the follow-through project in 
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Maine because the project had no materials available. 
Objective MD-1.2 could not be accomplished. 

' * • \ 

Objective MD-1.2P : 

The curriculum specialist will list all of the 
follow-through projects dealing with French speak- 
ing children. He will initiate contact with these 
and ask for their materials. 

Evaluation ; 

The curriculum specialist did list all of the follow- 
through projects dealing with French -speaking cKiTdr en ; 
such a list of projects is in the project files. The cur- 
riculum specialist did not have to initiate contact with the 
single project included in this list because personal contact 
was made weekly between the curriculum specialist of Title 
VII and the follow-through director. This contact indicated 
that no materials were available from the follow-through pro- 
ject; therefore, objective MD-1.2 could ndt be accomplished. 
Objective MD-1.2P was accomplished. ' «‘ 

Objective MD-1 . 3 : 

The director and/or curriculum specialist will 
contact several and will visit at least one of 
the Canadian bilingual projects. 
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Evaluation: 



Two Canadian bilingual projects were contacted: the 

St. Lambert Bilingual Project in Montreal and the Toronto 
Institute for Studies in Education and its Modern Language 
Center. The director and curriculum specialist visited one 
of these projects, the St. Lambert Bilingual Project." A 
report of this visit is included in the director's log. All 
Title VII staff who participated in this visit wrote a report 
on their visit; these were placed in the project files. 

In addition, the curriculum specialist made contact with 

two schools in Edmundston, New Brunswick, Canada", and one school 

in St. Anne, New Brunswick. The curriculum specialist visited” 

each of these schools in New Brunswick; one of the teachers 

also visited the school in St. Anne, New Brunswick. One of the 

schools taught French to English-dominant students; the other 

taught French to French-dominant students. Written reports of 

these visits were prepared by the curriculum coordinator and 
’ **/ 
are included in the project fdles. 

— / ■ 

/ 

Objective MD-1.3 was accomplished./ The director and cur- 
riculum specialist contacted five bilingual projects in Canada 

and visited four of these bilingual projects. 

/ 

: /. 

Objective MD-1 . 3P : 

The director and/or curriculum specialist will 
list the Canadian bilingual projects. He will t 
initiate contact with them and arrange for visits. 
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Evaluation : 






A list of three Canadian bilingual projects is in the 
G project files. A letter of inquiry to each of these projects 

was written and is also included in the project files. Addi- 
tional inquires by telephone were made to other projects 
in Canada , some of which were visited as indicated in 
Objective MD-1. 3. Objective' MD-1 .3 has been accomplished. 

Objective MD-1 . 4 : 

^ The director will establish a French Bilingual 

Consortium for materials, processes, testing 
x procedures/ ideas with Greenville, Lewiston 

' and New Orleans. Regular procedures for meet- 
ing and exchange of materials and ideas will be 
recorded. 

Evaluation : 

The director did not establish a French Bilingual Consortium, 
although he did attend the meeting of all Title VII French Bilin- 
gual directors on January 8-9, 1971 in Durham', New Hampshire. 

It has come to the attention of the evaluators that a different 
bilingual project in the United States has been assigned the re- 
sponsibility of organizing the French Bilingual Consortium. The 

' .s 

evaluators suggest, therefore, that this objective be revised to 
focus on the Valley Bilingual Project's cooperating with the 
project responsible for the French consortium; specification 
of contributions which should be made to the consortium might 
also be the focus of the objective. 
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Objective MD-1.4P; 



The director will visit the Greenville and 
Lewiston Projects. Written reports of the 
values of the trips will be recorded. 

Evaluation: 

The director visited both the Lewiston and Greenville pro^ 
jects , on January 7, 1971 and May 13-15, 1971 respectively. No 
written report on the Lewiston visit is included in the project 
files, although the director reported to the evaluator that he 
met with the Lewiston project director and curriculum coordina- 
tor. A report on the visit to the Greenville project is included 
in the project files. 

Objective MD-1.4P has been partically accomplished. The 
director visited both the Greenville and Lewiston projects and 
wrote a report on his visit to the Greenville project. The 
lack of a report on his visit to the Lewiston project prevents 
this objective from being completely accomplished. 

Ob j ective MD-2 . 1 : 

The director and/or curriculum specialist will 
contact at least six other bilingual projects in 
their second year of operation and gather ESL 

materials from them. 

/ 

Evaluation : 

The director contacted only a single second year Title VII 

bilingual project, the Mascenic Project in New Hampshire, about 

/ 



the possibility of gathering ESL materials from them. A con- 
ference was held between that project director and the St. 

John Valley Bilingual project director. No materials were 
received from this project. „ V 

Additional bilingual projects which might be able to con- 
tribute materials to. the St.. John Valley Bilingual project were 
also contacted through letters to individuals in the project. 

These included the director of the Center for Applied Linguistics, 
director of the Center for Curriculum Development in Audio-Visual 
Language Teaching, the executive secretary of the American Coun- 
cil on the Teaching of Foreign Languages, the co-director of 
Pace-rFabric, the senior supervisor of bilingual education of 
the Commonwealth of Massachusetts, the principal of the bilin- 
gual project school in Lafayette, Louisiana, the director of 
the Early Childhood Bilingual Education Project at Yeshivah 
University, and the director of English for Speakers of Other 
Languages Program at the Center for Applied Linguistics.' No 
ESL materials were received from any of these sources. 

• Objective MD-2.1 was. accomplished. The evaluators recom- 

♦ • 41 

mend that the project director attempt during the next project 
yeai^ to obtain ESL materials from additional second year Title 
VII bilingual projects which were not contacted during the 

• • i 

1970-71 project year. 
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Objective MD-2 .IP: 



The director will identify six bilingual projects 
most likely to provide help. He will initiate 
contact with them and ask for their materials . 



Evaluation : 




\ - 
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The director did not identify the Title VII bilingual 
projects most likely to provide help. He identified, instead 
the following bilingual projects which were not necessarily 
Title VII projects: St. Lambert School in Montreal, Mascenic 

Bilingual Project, Pace - Fabric Title II Project, Ecole 
Bilingue, Inc. in Belmont, Massachusetts, several schools in 
Edmunston , New Brunswick, Canada, the Lewiston Bilingual Pro- 
gram, the Happy Hollow School in Way land, Massac usetts, and 
the Washington International School. A letter of inquiry was 
sent to each of these sources which asked for materials. A 

copy, of the letter is in the project files. 

' • s ; 

Objective MD-2. IP was accomplished as stated originally. 

Second year Title VII projects were contacted. Materials were 

requested; a record of contact is included in the project. The 

evaluators; recommend that the project identify projects likely 

to provide help and contact them for ESL materials during the 

V 

next program year. . • 

Objective MD-3 . 1 : > .) 

The project staff will review' in writing materials 
collected in terms of objectives of the Valley's 
Bilingual Program. Appropriate materials will be , 
selected . ' 
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